00000100:00100000:0.0F:1788970141.768980:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970141.769054:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970141.769100:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0F:1788970141.769147:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732123904 00000100:00100000:3.0:1788970141.769163:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732123904 00000100:00100000:3.0:1788970141.769229:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:3.0:1788970141.769250:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732123904:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970141.769330:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732123904:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970141.769338:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 126 00000100:00100000:0.0:1788970141.769463:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124032 00000100:00100000:0.0:1788970141.769468:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124032 00000100:00100000:0.0:1788970141.769511:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1788970141.769519:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+23:2356:x1875870732124032:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970141.769563:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+23:2356:x1875870732124032:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 45us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970141.769569:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:1.0F:1788970141.769593:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124160 00000100:00100000:1.0:1788970141.769603:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124160 00000100:00100000:1.0:1788970141.769634:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:1.0:1788970141.769642:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+5:2352:x1875870732124160:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:1.0:1788970141.769662:0:15074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ea7 00000100:00080000:1.0:1788970141.769679:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9778798ba800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970141.769728:0:15074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00080000:3.0:1788970141.769819:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970141.769824:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970141.770039:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+2:2352:x1875870732124160:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 397us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970141.770047:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00010000:00010000:0.0:1788970141.770432:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970141.773855:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970141.773894:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970141.774005:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124416 00000100:00100000:2.0F:1788970141.774005:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124288 00000100:00100000:3.0:1788970141.774016:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124416 00000100:00100000:2.0:1788970141.774023:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124288 00000100:00100000:3.0:1788970141.774083:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:2.0:1788970141.774083:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788970141.774093:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732124416:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970141.774093:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2354:x1875870732124288:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970141.774159:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+8:2354:x1875870732124288:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00080000:0.0:1788970141.774160:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970141.774178:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788970141.781845:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732124416:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 7741us (7937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970141.781861:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:0.0:1788970141.783408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970141.783517:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124544 00000100:00100000:3.0:1788970141.783527:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124544 00000100:00100000:3.0:1788970141.783603:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:3.0:1788970141.783613:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2352:x1875870732124544:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1788970141.783647:0:15654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4edf 00000100:00080000:3.0:1788970141.783657:0:15654:0:(import.c:65:import_set_state_nolock()) ffff97787a6c3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970141.783716:0:15654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788970141.783944:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+2:2352:x1875870732124544:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 331us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970141.783951:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00010000:00010000:3.0:1788970141.784000:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970141.784074:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970141.800162:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970141.800309:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124672 00000100:00100000:3.0:1788970141.800326:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124672 00000100:00100000:3.0:1788970141.800400:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1788970141.800412:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2352:x1875870732124672:12345-192.168.202.9@tcp:9:kworker.0 00000020:00000080:3.0:1788970141.800444:0:15073:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ee6 00000100:00080000:3.0:1788970141.800458:0:15073:0:(import.c:65:import_set_state_nolock()) ffff97787a6c5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970141.800494:0:15073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1788970141.800723:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed26fada-f3c3-4d29-9040-b6cb88c25b67+2:2352:x1875870732124672:12345-192.168.202.9@tcp:9:kworker.0 Request processed in 312us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970141.800731:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00010000:00010000:3.0:1788970141.800755:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970141.801098:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788970141.958656:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970142.817221:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000001:00080000:1.0:1788970142.817254:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788970142.817275:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97784500e300 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1788970142.817292:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977852d7e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97784500e3c0 00000020:00080000:1.0:1788970142.817297:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff977852d7e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97784c47e800 00000020:00080000:1.0:1788970142.817318:0:14426:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1788970142.817496:0:14426:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788970142.981104:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970143.686985:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741536640:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687070:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687116:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741537152:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687142:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687168:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970143.687174:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687194:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687224:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741536768:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687250:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687267:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741537280:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687288:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687311:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970143.687317:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741536896:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687338:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687352:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970143.687382:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970143.687429:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536640 00000100:00100000:3.0:1788970143.687437:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536640 00000100:00100000:3.0:1788970143.687478:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788970143.687486:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778512f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741536640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687536:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778512f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741536640:12345-0@lo:400:kworker.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687542:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788970143.687572:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537152 00000100:00100000:3.0:1788970143.687576:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537152 00000100:00100000:3.0:1788970143.687610:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537024 00000100:00100000:3.0:1788970143.687613:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537024 00000100:00100000:3.0:1788970143.687624:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537280 00000100:00100000:3.0:1788970143.687626:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537280 00000100:00100000:3.0:1788970143.687640:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970143.687645:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741537152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687675:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741537152:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687682:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970143.687694:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970143.687700:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741537024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687726:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741537024:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687730:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970143.687740:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970143.687745:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741537280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687773:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741537280:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687785:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970143.687826:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536768 00000100:00100000:3.0:1788970143.687830:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536768 00000100:00100000:3.0:1788970143.687856:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741536896 00000100:00100000:3.0:1788970143.687859:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741536896 00000100:00100000:3.0:1788970143.687878:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970143.687884:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687916:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741536768:12345-0@lo:400:kworker.0 Request processed in 32us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687922:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970143.687932:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970143.687938:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977879bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741536896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.687965:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977879bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741536896:12345-0@lo:400:kworker.0 Request processed in 27us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.687970:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970143.688154:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537408 00000100:00100000:3.0:1788970143.688158:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537408 00000100:00100000:3.0:1788970143.688183:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970143.688189:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970143.688217:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970143.688250:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970143.688256:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788970143.688275:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970143.688279:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970143.688281:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970143.688656:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788970143.688669:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff977880e92580, transno 8589934595 00000004:00080000:3.0:1788970143.688681:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788970143.688703:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741536896:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.688720:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970143.688730:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741536768:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.688739:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741537280:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.689098:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.689109:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741536640:0@lo:400:kworker.0 00000100:00100000:3.0:1788970143.689118:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741537152:0@lo:400:kworker.0 00000001:00080000:2.0:1788970143.767481:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00100000:2.0:1788970143.767496:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000020:00000080:2.0:1788970143.767499:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787a6c0000/ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000020:00000080:2.0:1788970143.767517:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a6c0000/ed26fada-f3c3-4d29-9040-b6cb88c25b67 for lustre-OST0001 00000020:00000080:2.0:1788970143.767560:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a6c5800 for lustre-OST0001 00010000:00010000:1.0:1788970144.017170:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788970144.289108:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00000020:00000080:1.0:1788970144.289118:0:6702:0:(genops.c:885:class_export_put()) final put ffff9778798bb800/37f81da6-3302-422f-ab81-440f8fa5e2ee 00000001:00100000:1.0:1788970144.289151:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000020:00000080:1.0:1788970144.289153:0:6702:0:(genops.c:885:class_export_put()) final put ffff97787a6c4800/ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000020:00000080:3.0:1788970144.289411:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9778798bb800/37f81da6-3302-422f-ab81-440f8fa5e2ee for lustre-OST0000 00000020:00000080:3.0:1788970144.289462:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a6c4800/ed26fada-f3c3-4d29-9040-b6cb88c25b67 for lustre-OST0000 00000020:00000080:3.0:1788970144.289480:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778798ba800 for lustre-OST0000 00000020:00000080:3.0:1788970144.289485:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a6c3000 for lustre-OST0000 00010000:00010000:3.0:1788970145.028993:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970145.115172:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970145.115279:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732124800 00000100:00100000:3.0:1788970145.115290:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732124800 00000100:00100000:3.0:1788970145.115398:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00100000:3.0:1788970145.115410:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:14401:x1875870732124800:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788970145.115521:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:14401:x1875870732124800:12345-192.168.202.9@tcp:60:lhsmtool_posix.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970145.115529:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 63 00000100:00080000:2.0:1788970145.116050:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970145.117121:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970145.117255:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125056 00000100:00100000:1.0:1788970145.117263:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125056 00000100:00100000:1.0:1788970145.117347:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:1.0:1788970145.117358:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851faa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:14401:x1875870732125056:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788970145.117635:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851faa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+12:14401:x1875870732125056:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 279us (519us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788970145.117643:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788970145.735306:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741537536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970145.735400:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970145.735554:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537536 00000100:00100000:0.0:1788970145.735563:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537536 00000100:00100000:0.0:1788970145.735637:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970145.735646:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741537536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970145.735682:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970145.735731:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741537536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970145.735738:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788970145.736728:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741537536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788970145.736885:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970146.062555:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970146.880009:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970146.880065:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970146.880093:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970146.880133:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970146.880162:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125312 00000100:00100000:1.0:1788970146.880171:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125312 00000100:00100000:1.0:1788970146.880219:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125568 00000100:00100000:1.0:1788970146.880222:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125568 00000100:00100000:1.0:1788970146.880251:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788970146.880260:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+12:2356:x1875870732125312:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970146.880335:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+12:2356:x1875870732125312:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970146.880343:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788970146.880361:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:1.0:1788970146.880368:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2356:x1875870732125568:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970146.880403:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2356:x1875870732125568:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970146.880409:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00080000:1.0:1788970146.880427:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970146.880722:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125184 00000100:00100000:2.0:1788970146.880726:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125184 00000100:00100000:2.0:1788970146.880768:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:2.0:1788970146.880775:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732125184:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970146.880829:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732125184:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 55us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970146.880837:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 128 00000100:00100000:0.0:1788970146.880991:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125440 00000100:00100000:0.0:1788970146.880996:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125440 00000100:00100000:0.0:1788970146.881044:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:0.0:1788970146.881052:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732125440:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970146.881093:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2356:x1875870732125440:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 42us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970146.881101:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00080000:2.0:1788970146.881289:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788970147.082902:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970147.865116:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:1.0:1788970147.865131:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1788970147.865206:0:14426:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:3.0:1788970147.865223:0:14426:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:2.0:1788970148.103147:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970148.806752:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741537664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.806868:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.806916:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741538176:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.806943:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.806970:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970148.806975:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.806994:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.807032:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807057:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.807074:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807091:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.807109:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970148.807113:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807133:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970148.807164:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537664 00000100:00100000:3.0:1788970148.807173:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537664 00000100:00100000:3.0:1788970148.807219:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970148.807229:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741537664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807278:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3286:x1875870741537664:12345-0@lo:400:kworker.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807298:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788970148.807333:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538176 00000100:00100000:3.0:1788970148.807337:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538176 00000100:00100000:3.0:1788970148.807370:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538048 00000100:00100000:3.0:1788970148.807373:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538048 00000100:00100000:3.0:1788970148.807386:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538304 00000100:00100000:3.0:1788970148.807388:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538304 00000100:00100000:3.0:1788970148.807402:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970148.807407:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807440:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875870741538176:12345-0@lo:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807446:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970148.807458:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970148.807463:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807486:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875870741538048:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807491:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970148.807503:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970148.807508:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807536:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741538304:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807542:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970148.807564:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537792 00000100:00100000:3.0:1788970148.807567:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537792 00000100:00100000:3.0:1788970148.807591:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741537920 00000100:00100000:3.0:1788970148.807594:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741537920 00000100:00100000:3.0:1788970148.807612:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970148.807626:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807655:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537792:12345-0@lo:400:kworker.0 Request processed in 31us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807660:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970148.807670:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970148.807676:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807700:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741537920:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970148.807705:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970148.807749:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875870741538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807760:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:de37645b-91a3-4bf2-a071-03e750936262:3286:1875870741537664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807769:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875870741538176:0@lo:400:kworker.0 00000100:00080000:3.0:1788970148.807822:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970148.807827:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788970148.807829:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970148.807846:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807854:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788970148.807862:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741538304:0@lo:400:kworker.0 00000100:00100000:0.0:1788970148.808993:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741538432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970148.809053:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970148.809103:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538432 00000100:00100000:2.0:1788970148.809110:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538432 00000100:00100000:2.0:1788970148.809157:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970148.809165:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741538432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970148.809213:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970148.809394:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741538432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 230us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970148.809401:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970148.809471:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741538432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788970149.134306:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970150.150078:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970150.859430:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970150.859453:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741538560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970150.859532:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970150.859676:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538560 00000100:00100000:0.0:1788970150.859686:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538560 00000100:00100000:0.0:1788970150.859739:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970150.859748:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741538560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788970150.859781:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970150.859848:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741538560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970150.859855:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788970150.859873:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970150.859905:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741538560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970151.174869:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788970151.750079:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970151.750091:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970151.750157:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788970151.750179:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788970152.010008:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970152.010091:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125696 00000100:00100000:3.0:1788970152.010101:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125696 00000100:00100000:3.0:1788970152.010156:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:3.0:1788970152.010166:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732125696:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970152.010241:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732125696:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970152.010249:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 130 00000100:00100000:1.0:1788970152.026822:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970152.026909:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125824 00000100:00100000:3.0:1788970152.026921:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125824 00000100:00100000:3.0:1788970152.027005:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:3.0:1788970152.027016:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:2354:x1875870732125824:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970152.027102:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:2354:x1875870732125824:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970152.027109:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00080000:1.0:1788970152.027582:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970152.028834:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970152.028867:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970152.028895:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732125952 00000100:00100000:3.0:1788970152.028903:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732125952 00000100:00100000:3.0:1788970152.028953:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788970152.028962:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2354:x1875870732125952:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970152.029029:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2354:x1875870732125952:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970152.029036:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788970152.029055:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126080 00000100:00100000:3.0:1788970152.029058:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126080 00000100:00100000:3.0:1788970152.029090:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:3.0:1788970152.029096:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732126080:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970152.029126:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2354:x1875870732126080:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970152.029131:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00080000:3.0:1788970152.029146:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970152.029150:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788970152.197020:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970153.221819:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970153.928150:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741539072:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928221:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928283:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970153.928290:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741538688:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928319:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928342:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741539200:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928361:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928384:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741538816:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928408:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928427:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741539328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928447:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928465:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970153.928471:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741538944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928506:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970153.928534:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539072 00000100:00100000:1.0:1788970153.928542:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539072 00000100:00100000:1.0:1788970153.928583:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539200 00000100:00100000:1.0:1788970153.928585:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539200 00000100:00100000:1.0:1788970153.928603:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539328 00000100:00100000:1.0:1788970153.928605:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539328 00000100:00100000:1.0:1788970153.928620:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970153.928627:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741539072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928675:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741539072:12345-0@lo:400:kworker.0 Request processed in 47us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.928682:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970153.928698:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970153.928716:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741539200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928740:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741539200:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.928745:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788970153.928756:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970153.928761:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741539328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928784:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741539328:12345-0@lo:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.928809:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788970153.928824:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538688 00000100:00100000:1.0:1788970153.928827:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538688 00000100:00100000:1.0:1788970153.928847:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970153.928852:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741538688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928878:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741538688:12345-0@lo:400:kworker.0 Request processed in 26us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.928883:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788970153.928908:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538816 00000100:00100000:1.0:1788970153.928911:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538816 00000100:00100000:1.0:1788970153.928928:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741538944 00000100:00100000:1.0:1788970153.928930:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741538944 00000100:00100000:1.0:1788970153.928944:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970153.928961:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741538816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.928987:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741538816:12345-0@lo:400:kworker.0 Request processed in 38us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.928992:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970153.929002:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970153.929006:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741538944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929033:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741538944:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970153.929039:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788970153.929062:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970153.929065:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970153.929068:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970153.929090:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741538944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929098:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741538816:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929105:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741539328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929135:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741538688:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929142:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741539200:0@lo:400:kworker.0 00000100:00100000:1.0:1788970153.929150:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741539072:0@lo:400:kworker.0 00000100:00100000:0.0:1788970153.940923:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741539456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970153.941008:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970153.941066:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539456 00000100:00100000:0.0:1788970153.941074:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539456 00000100:00100000:0.0:1788970153.941119:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970153.941128:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741539456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970153.941174:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970153.941217:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741539456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970153.941224:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970153.941272:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741539456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788970154.245017:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788970154.780647:0:17328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:09:13 (1788970153) 00010000:00010000:1.0:1788970155.272532:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970155.982049:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741539584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970155.982126:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970155.982240:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539584 00000100:00100000:1.0:1788970155.982250:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539584 00000100:00100000:1.0:1788970155.982330:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970155.982341:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741539584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970155.982383:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970155.982449:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741539584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970155.982463:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788970155.985599:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970155.985694:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741539584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788970156.300308:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970157.113831:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970157.113883:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970157.114046:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126208 00000100:00100000:1.0:1788970157.114057:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126208 00000100:00100000:1.0:1788970157.114111:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:1.0:1788970157.114122:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732126208:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970157.114268:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2356:x1875870732126208:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 147us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970157.114276:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 132 00000100:00100000:2.0:1788970157.116558:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126336 00000100:00100000:2.0:1788970157.116568:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126336 00000100:00100000:2.0:1788970157.116634:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:2.0:1788970157.116643:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:2356:x1875870732126336:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970157.116711:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:2356:x1875870732126336:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 60us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970157.116718:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00080000:3.0:1788970157.117321:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970157.133678:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970157.133727:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970157.133757:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126464 00000100:00100000:2.0:1788970157.133767:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126464 00000100:00100000:2.0:1788970157.133852:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:2.0:1788970157.133873:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2355:x1875870732126464:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970157.133953:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2355:x1875870732126464:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970157.133961:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00080000:2.0:1788970157.133987:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970157.136877:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126592 00000100:00100000:0.0:1788970157.136889:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126592 00000100:00100000:0.0:1788970157.136981:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1788970157.136991:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2355:x1875870732126592:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970157.137068:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2355:x1875870732126592:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 78us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970157.137075:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00080000:2.0:1788970157.137586:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788970157.326734:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970158.341684:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970159.045291:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970159.045316:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741539712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970159.045400:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970159.045775:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539712 00000100:00100000:2.0:1788970159.045784:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539712 00000100:00100000:2.0:1788970159.045877:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970159.045887:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741539712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970159.045933:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970159.045979:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741539712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970159.045986:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788970159.046007:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970159.046043:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741539712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970159.050043:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741540096:0@lo:400:kworker.0 00000100:00100000:2.0:1788970159.050373:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970159.050423:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540096 00000100:00100000:2.0:1788970159.050431:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540096 00000100:00100000:0.0:1788970159.050545:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741539968:0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.050582:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970159.050607:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970159.050613:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741539840:0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.050640:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970159.050688:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539968 00000100:00100000:0.0:1788970159.050693:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539968 00000100:00100000:0.0:1788970159.050745:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970159.050754:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741539968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.050821:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741539968:12345-0@lo:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970159.050828:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970159.051042:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970159.051048:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741540096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970159.051087:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741540096:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970159.051103:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970159.051141:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741540096:0@lo:400:kworker.0 00000100:00100000:3.0:1788970159.051652:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741539840 00000100:00100000:3.0:1788970159.051658:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741539840 00000100:00100000:3.0:1788970159.051685:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788970159.051693:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3284:x1875870741539840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970159.051730:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de37645b-91a3-4bf2-a071-03e750936262+19:3284:x1875870741539840:12345-0@lo:400:kworker.0 Request processed in 38us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970159.051736:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788970159.052012:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970159.052054:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741539840:0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.052068:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741539968:0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.052830:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970159.052969:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970159.052980:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741540224:0@lo:400:kworker.0 00000100:00100000:1.0:1788970159.053029:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970159.053067:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540224 00000100:00100000:1.0:1788970159.053073:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540224 00000100:00100000:1.0:1788970159.053127:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970159.053134:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741540224:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788970159.053399:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970159.053515:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741540352:0@lo:400:kworker.0 00000100:00100000:0.0:1788970159.053546:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970159.053779:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741540224:12345-0@lo:400:kworker.0 Request processed in 644us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970159.053814:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970159.053832:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540352 00000100:00100000:1.0:1788970159.053837:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540352 00000100:00100000:0.0:1788970159.054428:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741540224:0@lo:400:kworker.0 00000100:00080000:0.0:1788970159.054465:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970159.060639:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970159.060669:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741540352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970159.060803:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741540352:12345-0@lo:400:kworker.0 Request processed in 135us (7240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970159.060811:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970159.061032:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741540352:0@lo:400:kworker.0 00000100:00100000:2.0:1788970159.248684:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970159.248747:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970159.249854:0:15654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732127104 00000100:00100000:3.0:1788970159.249870:0:15654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732127104 00000100:00100000:3.0:1788970159.249991:0:15654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:3.0:1788970159.250005:0:15654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+6:2352:x1875870732127104:12345-192.168.202.9@tcp:9:umount.0 00000020:00000080:3.0:1788970159.250060:0:15654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4eae 00000020:00010000:3.0:1788970159.250070:0:15654:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787a6c6000: total 0 00000100:00080000:3.0:1788970159.250077:0:15654:0:(import.c:65:import_set_state_nolock()) ffff97787a6c4000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788970159.250123:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788970159.250131:0:15654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1788970159.254050:0:15654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37f81da6-3302-422f-ab81-440f8fa5e2ee+4:2352:x1875870732127104:12345-192.168.202.9@tcp:9:umount.0 Request processed in 4027us (5281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970159.254078:0:15654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:1.0:1788970159.254823:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126720 00000100:00100000:1.0:1788970159.254838:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126720 00000020:00010000:0.0:1788970159.254884:0:14377:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787a6c6000: total 0 00010000:00010000:0.0:1788970159.254895:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970159.254933:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:1.0:1788970159.254948:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977850c04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+13:2353:x1875870732126720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970159.254957:0:14377:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787a6c6000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788970159.254967:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788970159.254994:0:14377:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788970159.255001:0:14377:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788970159.255011:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44d200/0x5d0de860b05b4e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec5c expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.255031:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970159.255037:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b51ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee00 expref: 3 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970159.255067:0:14377:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787a6c6000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788970159.255081:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970159.255083:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970159.255086:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970159.255098:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977850c04450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:2353:x1875870732126720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 153us (6428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970159.255107:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1788970159.260910:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970159.261061:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732126848 00000100:00100000:3.0:1788970159.261074:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732126848 00000100:00100000:3.0:1788970159.261160:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:3.0:1788970159.261173:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:2353:x1875870732126848:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970159.261194:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970159.261221:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44c400/0x5d0de860b05b4e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec86 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970159.261242:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970159.261312:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:2353:x1875870732126848:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970159.261320:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788970159.266209:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970159.266496:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732127232 00000100:00100000:3.0:1788970159.266511:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732127232 00000100:00100000:3.0:1788970159.266605:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:3.0:1788970159.266618:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:2355:x1875870732127232:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970159.266661:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970159.266688:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44ca00/0x5d0de860b05b4f09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed27 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970159.266710:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970159.266786:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:2355:x1875870732127232:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 171us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970159.266838:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970159.285010:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970159.285131:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732128128 00000100:00100000:3.0:1788970159.285147:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732128128 00000100:00100000:3.0:1788970159.285274:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00100000:3.0:1788970159.285288:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+11:2352:x1875870732128128:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:3.0:1788970159.285339:0:14388:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ea0 00000020:00010000:3.0:1788970159.285360:0:14388:0:(genops.c:1920:obd_stale_export_put()) Put export ffff977879426800: total 0 00000100:00080000:3.0:1788970159.285366:0:14388:0:(import.c:65:import_set_state_nolock()) ffff9778798bc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970159.285417:0:14388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:1.0:1788970159.285619:0:14376:0:(genops.c:1906:obd_stale_export_get()) Get export ffff977879426800: total 0 00010000:00010000:1.0:1788970159.285677:0:14376:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff977879426800, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1788970159.285721:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff977858b3ce00) 00010000:00010000:1.0:1788970159.285725:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970159.285735:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a8e00/0x5d0de860b05b5140 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4edc8 expref: 10 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285768:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:1.0:1788970159.285771:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970159.285776:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44d000/0x5d0de860b05b4fa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed43 expref: 9 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285843:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9778519ab500) 00010000:00010000:1.0:1788970159.285847:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970159.285851:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b4f6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed35 expref: 8 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285870:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff977849672000) 00010000:00010000:1.0:1788970159.285873:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970159.285877:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4a00/0x5d0de860b05b519b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eddd expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285941:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977851ac1f00) 00010000:00010000:1.0:1788970159.285943:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970159.285948:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97787f44c000/0x5d0de860b05b4f4f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed2e expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285963:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9778519ab800) 00010000:00010000:1.0:1788970159.285966:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788970159.285970:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5028 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed6d expref: 5 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970159.285987:0:14376:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff977879426800, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1788970159.286000:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970159.286002:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970159.286005:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970159.286684:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37f81da6-3302-422f-ab81-440f8fa5e2ee+3:2352:x1875870732128128:12345-192.168.202.9@tcp:39:umount.0 Request processed in 1392us (1684us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788970159.286696:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 64 00000100:00080000:0.0:1788970159.289060:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788970159.365020:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970160.389221:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970161.096007:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741540480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970161.096161:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970161.097784:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540480 00000100:00100000:1.0:1788970161.097833:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540480 00000100:00100000:1.0:1788970161.097956:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970161.097968:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741540480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970161.098021:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970161.098116:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741540480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970161.098124:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788970161.098325:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970161.098396:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741540480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788970161.413537:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970161.775658:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970161.775716:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970161.775771:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970161.775895:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732128256 00000100:00100000:0.0:1788970161.775908:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732128256 00000100:00100000:0.0:1788970161.775968:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732128384 00000100:00100000:0.0:1788970161.775972:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732128384 00000100:00100000:0.0:1788970161.775986:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732128512 00000100:00100000:0.0:1788970161.775989:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732128512 00000100:00100000:0.0:1788970161.776006:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970161.776017:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+12:2355:x1875870732128256:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970161.776033:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970161.776056:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4400/0x5d0de860b05b4ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ecbe expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970161.776081:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970161.776151:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+11:2355:x1875870732128256:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 135us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970161.776159:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970161.776178:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970161.776185:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+10:2355:x1875870732128384:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970161.776193:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970161.776213:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4600/0x5d0de860b05b4eca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ece8 expref: 10 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970161.776223:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970161.776253:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+9:2355:x1875870732128384:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 68us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970161.776260:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970161.776275:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:0.0:1788970161.776282:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+8:2353:x1875870732128512:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970161.776291:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970161.776300:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92600/0x5d0de860b05b4f02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed20 expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970161.776309:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970161.776326:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+7:2353:x1875870732128512:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 45us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970161.776333:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1788970161.799512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970161.799611:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732128768 00000100:00100000:0.0:1788970161.799623:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732128768 00000100:00100000:0.0:1788970161.799711:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00100000:0.0:1788970161.799722:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+6:2352:x1875870732128768:12345-192.168.202.9@tcp:39:umount.0 00000020:00000080:0.0:1788970161.799763:0:16264:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ed8 00000020:00010000:0.0:1788970161.799772:0:16264:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97787a6c5000: total 0 00000100:00080000:0.0:1788970161.799777:0:16264:0:(import.c:65:import_set_state_nolock()) ffff97787a6c2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970161.799827:0:16264:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:0.0:1788970161.800036:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed26fada-f3c3-4d29-9040-b6cb88c25b67+5:2352:x1875870732128768:12345-192.168.202.9@tcp:39:umount.0 Request processed in 316us (533us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1788970161.800044:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 65 00000100:00080000:3.0:1788970161.800368:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788970161.800416:0:14376:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97787a6c5000: total 0 00010000:00010000:1.0:1788970161.800421:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970161.800461:0:14376:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97787a6c5000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788970161.800510:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:1.0:1788970161.800514:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970161.800522:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9778414a9200/0x5d0de860b05b4fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ed4a expref: 4 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970161.800544:0:14376:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97787a6c5000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788970161.800552:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970161.800554:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970161.800555:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970161.832367:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970161.833593:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129024 00000100:00100000:3.0:1788970161.833606:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129024 00000100:00100000:3.0:1788970161.833677:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 134 00000100:00100000:3.0:1788970161.833687:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+7:2352:x1875870732129024:12345-192.168.202.9@tcp:251:umount.0 00000020:00000080:3.0:1788970161.833733:0:14380:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4e7d 00000020:00010000:3.0:1788970161.833741:0:14380:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9777418a2000: total 0 00000100:00080000:3.0:1788970161.833745:0:14380:0:(import.c:65:import_set_state_nolock()) ffff9777418a4800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788970161.833861:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:060bfcf6-2974-43e0-a9e8-47e12cb6b1cb+3:2352:x1875870732129024:12345-192.168.202.9@tcp:251:umount.0 Request processed in 176us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970161.833869:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 134 00000020:00010000:3.0:1788970161.833950:0:14377:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9777418a2000: total 0 00010000:00010000:3.0:1788970161.833989:0:14377:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9777418a2000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788970161.834021:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44c800/0x5d0de860b05b4e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ec55 expref: 2 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970161.834035:0:14377:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9777418a2000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788970161.834043:0:14377:0:(genops.c:885:class_export_put()) final put ffff9777418a2000/060bfcf6-2974-43e0-a9e8-47e12cb6b1cb 00010000:00010000:3.0:1788970161.834056:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970161.834058:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970161.834060:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788970161.834067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9777418a2000/060bfcf6-2974-43e0-a9e8-47e12cb6b1cb for MGS 00000020:00000080:3.0:1788970161.834096:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9777418a4800 for MGS 00000040:00080000:3.0:1788970161.989107:0:14422:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788970161.989118:0:14422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788970161.989153:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788970161.989160:0:14422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788970162.438060:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788970163.206204:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000001:00080000:2.0:1788970163.206229:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1788970163.206237:0:5854:0:(genops.c:885:class_export_put()) final put ffff97787a6c5000/ed26fada-f3c3-4d29-9040-b6cb88c25b67 00000001:00100000:2.0:1788970163.206258:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00000001:00080000:2.0:1788970163.206265:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1788970163.206267:0:5854:0:(genops.c:885:class_export_put()) final put ffff977879426800/37f81da6-3302-422f-ab81-440f8fa5e2ee 00000020:00000080:2.0:1788970163.206642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a6c5000/ed26fada-f3c3-4d29-9040-b6cb88c25b67 for lustre-MDT0000 00000020:00000080:2.0:1788970163.219029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff977879426800/37f81da6-3302-422f-ab81-440f8fa5e2ee for lustre-MDT0000 00000020:00000080:2.0:1788970163.219114:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a6c2000 for lustre-MDT0000 00000020:00000080:2.0:1788970163.219120:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778798bc800 for lustre-MDT0000 00010000:00010000:3.0:1788970163.461720:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970164.171313:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741540608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970164.171423:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970164.171522:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540608 00000100:00100000:2.0:1788970164.171533:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540608 00000100:00100000:2.0:1788970164.171611:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788970164.171622:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741540608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970164.171670:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970164.171726:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741540608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970164.171733:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788970164.171756:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970164.171837:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741540608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970164.182393:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741540992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.182496:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.182579:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970164.182586:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741540864:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.182620:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.182666:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540864 00000100:00100000:1.0:1788970164.182675:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540864 00000100:00100000:1.0:1788970164.182747:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970164.182757:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741540864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.182847:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741540864:12345-0@lo:400:kworker.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.182864:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788970164.182918:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741540864:0@lo:400:kworker.0 00000100:00080000:1.0:1788970164.182966:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970164.182981:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741541120:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183008:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.183029:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970164.183036:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741540736:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183086:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.183110:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741541248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183131:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.183158:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540736 00000100:00100000:1.0:1788970164.183163:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540736 00000100:00100000:1.0:1788970164.183195:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788970164.183202:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741540736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183238:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de37645b-91a3-4bf2-a071-03e750936262+19:3285:x1875870741540736:12345-0@lo:400:kworker.0 Request processed in 36us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.183245:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788970164.183281:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741540736:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183308:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741540992 00000100:00100000:1.0:1788970164.183313:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741540992 00000100:00100000:1.0:1788970164.183341:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541120 00000100:00100000:1.0:1788970164.183344:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541120 00000100:00100000:1.0:1788970164.183361:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541248 00000100:00100000:1.0:1788970164.183364:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541248 00000100:00100000:1.0:1788970164.183379:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970164.183385:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741540992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183423:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741540992:12345-0@lo:400:kworker.0 Request processed in 38us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.183430:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970164.183442:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970164.183448:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741541120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183479:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741541120:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.183496:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970164.183509:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788970164.183515:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741541248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183546:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875870741541248:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.183551:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788970164.183566:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970164.183586:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741540992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183607:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741541248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970164.183616:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741541120:0@lo:400:kworker.0 00000001:00100000:2.0:1788970164.289106:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37f81da6-3302-422f-ab81-440f8fa5e2ee 00000020:00000080:2.0:1788970164.289118:0:7615:0:(genops.c:885:class_export_put()) final put ffff97787a6c6000/37f81da6-3302-422f-ab81-440f8fa5e2ee 00000020:00000080:1.0:1788970164.289290:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a6c6000/37f81da6-3302-422f-ab81-440f8fa5e2ee for lustre-OST0001 00000020:00000080:1.0:1788970164.289381:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a6c4000 for lustre-OST0001 00000020:01000004:2.0:1788970164.370679:0:17526:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788970164.385081:0:17526:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788970164.385160:0:17526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.385179:0:17526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.385188:0:17526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.385196:0:17526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.385227:0:17526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788970164.385236:0:17526:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788970164.385272:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970164.385280:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788970164.385288:0:17526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970164.385324:0:17526:0:(import.c:65:import_set_state_nolock()) ffff97784c249800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788970164.385481:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741541376:0@lo:39:umount.0 00000100:00100000:0.0:1788970164.385575:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970164.385730:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970164.385740:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.385750:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44dc00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970164.385754:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.385763:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970164.385779:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970164.385785:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970164.385817:0:14376:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970164.385821:0:14376:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970164.385864:0:14376:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.385871:0:14376:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970164.385897:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.385905:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44dc00/0x5d0de860b05b4bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4bb3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.385919:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.385921:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.385923:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970164.385932:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970164.385944:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741541504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.385984:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970164.386030:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541504 00000100:00100000:3.0:1788970164.386039:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541504 00000100:00100000:3.0:1788970164.386120:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970164.386130:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+19:3284:x1875870741541504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.386145:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970164.386162:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dce00/0x5d0de860b05b4bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4bac expref: 19 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.386184:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970164.386227:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de37645b-91a3-4bf2-a071-03e750936262+18:3284:x1875870741541504:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970164.386235:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970164.386288:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741541504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970164.386926:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541376 00000100:00100000:2.0:1788970164.386934:0:16264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541376 00000100:00100000:2.0:1788970164.386986:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788970164.386995:0:16264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875870741541376:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788970164.387025:0:16264:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4bdd 00000100:00080000:2.0:1788970164.387036:0:16264:0:(import.c:65:import_set_state_nolock()) ffff977852b16000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788970164.387181:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970164.388017:0:16264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875870741541376:12345-0@lo:39:umount.0 Request processed in 1018us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970164.388029:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00000080:2.0:1788970164.388043:0:16264:0:(genops.c:885:class_export_put()) final put ffff977852b14800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788970164.388200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977852b14800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788970164.388276:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff977852b16000 for lustre-MDT0000 00000100:00080000:0.0:1788970164.388353:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97784c249800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788970164.388373:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741541376:0@lo:39:umount.0 00000100:00080000:3.0:1788970164.388446:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970164.388451:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970164.388457:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970164.389587:0:17526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389608:0:17526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389617:0:17526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389625:0:17526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389654:0:17526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970164.389675:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970164.389683:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389712:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44da00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970164.389717:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389726:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970164.389733:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970164.389740:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970164.389743:0:14376:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788970164.389787:0:14376:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389822:0:14376:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970164.389862:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389870:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44da00/0x5d0de860b05b4b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.389888:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.389890:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.389892:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970164.389916:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741541632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.390001:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970164.391217:0:17526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391232:0:17526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391240:0:17526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391246:0:17526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391265:0:17526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970164.391272:0:17526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391280:0:17526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391287:0:17526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391293:0:17526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391307:0:17526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788970164.391314:0:17526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391321:0:17526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391342:0:17526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391349:0:17526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970164.391357:0:17526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788970164.391361:0:17526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788970164.391368:0:17526:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788970164.391415:0:17526:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788970164.391420:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788970164.391426:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970164.391433:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788970164.391440:0:17526:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97787a260800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970164.391446:0:17526:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97787a255800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970164.391452:0:17526:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9778650e99c0) has exports, disconnecting them 00000020:00080000:2.0:1788970164.391457:0:17526:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97787a260800), last request at 1788970164 00000020:00000080:2.0:1788970164.391466:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4d9d 00000100:00080000:2.0:1788970164.391488:0:17526:0:(import.c:65:import_set_state_nolock()) ffff97787a262800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788970164.391538:0:17526:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787a260800): rc 0 00000020:00000080:2.0:1788970164.391541:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a260800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788970164.391553:0:17526:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97787a255800), last request at 1788970164 00000020:00000080:2.0:1788970164.391557:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4c62 00000100:00080000:2.0:1788970164.391562:0:17526:0:(import.c:65:import_set_state_nolock()) ffff97787a256800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788970164.391574:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a260800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788970164.391624:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a262800 for lustre-MDT0000 00000020:00080000:2.0:1788970164.391638:0:17526:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787a255800): rc 0 00000020:00000080:2.0:1788970164.391647:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a255800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788970164.391661:0:17526:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc26c2f2fae0 00000020:00000080:2.0:1788970164.391675:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a255800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788970164.391705:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a256800 for lustre-MDT0000 00000100:00080000:2.0:1788970164.391732:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970164.391738:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788970164.391760:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788970164.391864:0:17526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788970164.391890:0:17526:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788970164.391911:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970164.391913:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:2.0:1788970164.391922:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788970164.391997:0:17526:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788970164.392007:0:17526:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788970164.392044:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9778650e99c0) has no exports 00000100:00100000:3.0:1788970164.393261:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541632 00000100:00100000:3.0:1788970164.393276:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541632 00000100:00100000:3.0:1788970164.393379:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970164.393390:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977850c04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+18:3284:x1875870741541632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.393408:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970164.393432:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f93800/0x5d0de860b05b4b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4b12 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.393452:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970164.393551:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977850c04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de37645b-91a3-4bf2-a071-03e750936262+17:3284:x1875870741541632:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970164.393559:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788970164.393631:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788970164.393641:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.393650:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970164.393655:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394767:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970164.394781:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970164.394802:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970164.394805:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788970164.394809:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788970164.394863:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394890:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970164.394930:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394938:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5200/0x5d0de860b05b4dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4db2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394960:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970164.394966:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394973:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970164.394976:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.394985:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970164.394993:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970164.394998:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788970164.395001:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788970164.395003:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788970164.395019:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395026:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970164.395032:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395052:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5400/0x5d0de860b05b4f2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4f33 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395061:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970164.395066:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395084:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44cc00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970164.395088:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395095:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970164.395101:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970164.395106:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970164.395108:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788970164.395110:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788970164.395127:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395133:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970164.395142:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395149:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44cc00/0x5d0de860b05b4b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4b0b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395173:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.395175:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.395177:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970164.395309:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741542016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.395382:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970164.395440:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970164.395446:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f4661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741542144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.395467:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970164.395499:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741542016 00000100:00100000:3.0:1788970164.395508:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741542016 00000100:00100000:3.0:1788970164.395552:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741542144 00000100:00100000:3.0:1788970164.395555:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741542144 00000100:00100000:3.0:1788970164.395573:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970164.395583:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+18:3285:x1875870741542016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.395598:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970164.395612:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9400/0x5d0de860b05b4db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4dab expref: 18 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395632:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970164.395666:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+17:3285:x1875870741542016:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970164.395673:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970164.395691:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970164.395697:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+16:3285:x1875870741542144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.395705:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970164.395713:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977852ff4c00/0x5d0de860b05b4f33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4f2c expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.395737:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970164.395760:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+15:3285:x1875870741542144:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970164.395766:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970164.395830:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f4661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741542144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.395839:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:de37645b-91a3-4bf2-a071-03e750936262:3285:1875870741542016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970164.399901:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741541760:0@lo:9:umount.0 00000100:00100000:1.0:1788970164.400012:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.400171:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741541888:0@lo:9:umount.0 00000100:00100000:1.0:1788970164.400201:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970164.400259:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541760 00000100:00100000:1.0:1788970164.400270:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541760 00000100:00100000:1.0:1788970164.400325:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741541888 00000100:00100000:1.0:1788970164.400328:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741541888 00000100:00100000:1.0:1788970164.400352:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970164.400362:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875870741541760:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788970164.400403:0:15074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4c7e 00000100:00080000:1.0:1788970164.400416:0:15074:0:(import.c:65:import_set_state_nolock()) ffff97787a260000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970164.400490:0:15074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788970164.400958:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3282:x1875870741541760:12345-0@lo:9:umount.0 Request processed in 595us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.400967:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970164.400987:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970164.400995:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875870741541888:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788970164.401011:0:15074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4db9 00000100:00080000:1.0:1788970164.401021:0:15074:0:(import.c:65:import_set_state_nolock()) ffff9778798b9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970164.401037:0:15074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00010000:00010000:3.0:1788970164.401244:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970164.401261:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.401299:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970164.401344:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741542272 00000100:00100000:3.0:1788970164.401349:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741542272 00000100:00100000:3.0:1788970164.401390:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970164.401396:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+15:3283:x1875870741542272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.401409:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970164.401431:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92800/0x5d0de860b05b4b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4b04 expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.401453:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970164.401478:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de37645b-91a3-4bf2-a071-03e750936262+14:3283:x1875870741542272:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970164.401484:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970164.401519:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970164.401543:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:de37645b-91a3-4bf2-a071-03e750936262:3284:1875870741541632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970164.401556:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970164.403006:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788970164.403029:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788970164.403031:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970164.403037:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741541760:0@lo:9:umount.0 00000100:00100000:1.0:1788970164.403879:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3282:x1875870741541888:12345-0@lo:9:umount.0 Request processed in 2880us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970164.403893:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788970164.404111:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778792c8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788970164.404135:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788970164.404137:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970164.404141:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741541888:0@lo:9:umount.0 00000020:00080000:2.0:1788970164.425713:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9778650e99c0) has no exports 00010000:00010000:3.0:1788970164.486301:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788970164.524665:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b5f 00000020:00000080:2.0:1788970164.524690:0:17526:0:(genops.c:885:class_export_put()) final put ffff977844fc3000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788970164.525184:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788970164.527352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977844fc3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788970164.527415:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970164.527428:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970164.527434:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9778652f99c0) has no exports 00000020:00000080:3.0:1788970164.529385:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b58 00000020:00000080:3.0:1788970164.529405:0:17526:0:(genops.c:885:class_export_put()) final put ffff97784eb34000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970164.529508:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970164.529522:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788970164.529525:0:17526:0:(genops.c:885:class_export_put()) final put ffff977878837800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788970164.529528:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff977878837800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788970164.529534:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788970164.529780:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97784eb34000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788970164.530325:0:17526:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977878e41ea0 - data ffff9778530606c0/ffff97787a2dfc00 00000020:01000000:3.0:1788970164.530502:0:17526:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97787f4eaae0 - data ffff9778532fbd80/ffff97784effcc00 00000001:00000004:3.0:1788970164.543128:0:17526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1788970164.650617:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970164.650629:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788970164.650650:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970164.650653:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788970164.651933:0:14410:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788970164.651944:0:14410:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788970164.651959:0:14410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788970164.662786:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970164.662824:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1788970164.662844:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970164.662848:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788970164.663724:0:14412:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788970164.663732:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788970164.663754:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000001:00100000:1.0:1788970164.789234:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970164.789246:0:6702:0:(genops.c:885:class_export_put()) final put ffff97787a265800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970164.789841:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a265800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788970164.789930:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787a260000 for lustre-OST0000 00000020:00000080:1.0:1788970164.828976:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b27 00000020:00000080:1.0:1788970164.828994:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a5b8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788970164.829095:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970164.829897:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b3c 00000020:00000080:1.0:1788970164.829907:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787882c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788970164.829925:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788970164.829934:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.829945:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788970164.829950:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9778650eb380) has no exports 00000004:01000000:1.0:1788970164.830151:0:17526:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788970164.830162:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b89 00000020:00000080:1.0:1788970164.830167:0:17526:0:(genops.c:885:class_export_put()) final put ffff97784c0a7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788970164.830172:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788970164.830176:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.830196:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970164.830199:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff97787921cd40) has no exports 00000020:00000080:1.0:1788970164.830205:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b82 00000020:00000080:1.0:1788970164.830210:0:17526:0:(genops.c:885:class_export_put()) final put ffff9778792ca000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788970164.830358:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788970164.830369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c0a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788970164.830382:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778792ca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788970164.830620:0:17526:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788970164.830626:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788970164.830631:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:1.0:1788970164.830638:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970164.830642:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788970164.830688:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778792c8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788970164.830694:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.830701:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970164.830705:0:17526:0:(genops.c:885:class_export_put()) final put ffff9778506c1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970164.830708:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff9778506c1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788970164.830716:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970164.830830:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b74 00000020:00000080:1.0:1788970164.830836:0:17526:0:(genops.c:885:class_export_put()) final put ffff9778506c2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788970164.830858:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788970164.830863:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970164.830867:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778506c2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788970164.830867:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970164.830870:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff97787921b380) has no exports 00000020:00000080:1.0:1788970164.830875:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b6d 00000020:00000080:1.0:1788970164.830878:0:17526:0:(genops.c:885:class_export_put()) final put ffff9778506c2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788970164.830931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778506c2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788970164.831241:0:17526:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788970164.831246:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788970164.831248:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788970164.831253:0:17526:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970164.831255:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970164.831294:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.831300:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970164.831330:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.831334:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970164.831337:0:17526:0:(genops.c:885:class_export_put()) final put ffff9778601f8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970164.831348:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff9778601f8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788970164.831357:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970164.831379:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778506c0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788970164.831385:0:36:0:(genops.c:885:class_export_put()) final put ffff9778506c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788970164.831387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778506c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788970164.831392:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970164.832649:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b43 00000020:00000080:1.0:1788970164.832663:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787882f800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788970164.832679:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788970164.832684:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.832692:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788970164.832697:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9778650ecd40) has no exports 00000020:00000080:1.0:1788970164.832726:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.832733:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788970164.833001:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4b4a 00000020:00000080:1.0:1788970164.833007:0:17526:0:(genops.c:885:class_export_put()) final put ffff977878829000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788970164.833018:0:17526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787a5ba000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788970164.833022:0:17526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787a5ba000 3 00000020:01000004:1.0:1788970164.833026:0:17526:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97787a5ba000 from lustre-MDT0000 00000020:00000080:1.0:1788970164.833052:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.833056:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788970164.833060:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a5bf000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788970164.833063:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5bf000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788970164.833075:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788970164.833117:0:17526:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788970164.833122:0:17526:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788970164.833126:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788970164.833128:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.833131:0:17526:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788970164.833140:0:17526:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9778508ec000 de37645b-91a3-4bf2-a071-03e750936262 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970164.833146:0:17526:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9778650e8000) has exports, disconnecting them 00000020:00080000:1.0:1788970164.833151:0:17526:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9778508ec000), last request at 1788970079 00000020:00000080:1.0:1788970164.833169:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4aef 00000020:00010000:1.0:1788970164.833173:0:17526:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9778508ec000: total 2 00000100:00080000:1.0:1788970164.833179:0:17526:0:(import.c:65:import_set_state_nolock()) ffff9778508ef800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788970164.833206:0:17526:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9778508ec000): rc 0 00000020:00080000:1.0:1788970164.833223:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9778650e8000) has no exports 00000020:00000080:2.0:1788970164.835176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788970164.835190:0:36:0:(genops.c:885:class_export_put()) final put ffff97787882b800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788970164.835193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97787882b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788970164.835199:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788970164.835401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff977878829000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788970164.836523:0:14382:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff977847364600:14382] 1 exiting: rc = 0 00000100:00100000:1.0:1788970164.836646:0:14380:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff97784ea22c00:14380] 0 exiting: rc = 1 00000020:00010000:3.0:1788970164.837150:0:14376:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9778508ec000: total 0 00010000:00010000:3.0:1788970164.837156:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.837205:0:14376:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9778508ec000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788970164.837245:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9600/0x5d0de860b05b4f25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4f1e expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837266:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd600/0x5d0de860b05b4c15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4c0e expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837283:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f485a00/0x5d0de860b05b4c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4c1c expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837294:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f484600/0x5d0de860b05b4c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4c46 expref: 6 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837305:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f44d400/0x5d0de860b05b4d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4d57 expref: 5 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837329:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9000/0x5d0de860b05b4f17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4f10 expref: 4 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837343:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778414a9e00/0x5d0de860b05b4d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4d81 expref: 3 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837352:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f485e00/0x5d0de860b05b4afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d0de860b05b4af6 expref: 2 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970164.837364:0:14376:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9778508ec000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788970164.837379:0:14376:0:(genops.c:885:class_export_put()) final put ffff9778508ec000/de37645b-91a3-4bf2-a071-03e750936262 00010000:00010000:3.0:1788970164.837405:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.837407:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970164.837409:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788970164.837673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9778508ec000/de37645b-91a3-4bf2-a071-03e750936262 for MGS 00000020:00000080:1.0:1788970164.837711:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778508ef800 for MGS 00000100:00100000:0.0:1788970164.837784:0:14383:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff977847365600:14383] 2 exiting: rc = 0 00000100:00100000:1.0:1788970164.837874:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837885:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837892:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837899:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837916:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837924:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837932:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837938:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837943:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837949:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837955:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837961:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837967:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837974:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837982:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837987:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837994:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.837999:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838005:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838012:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838017:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838022:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838026:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838031:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838035:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838039:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838043:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838047:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838051:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838064:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838069:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838074:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838079:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838083:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838088:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838092:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838096:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838101:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838106:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838110:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838114:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838118:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838121:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838125:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838130:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838134:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838138:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838142:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838147:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838151:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838154:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838158:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838162:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838166:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838170:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838174:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838177:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838181:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838185:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838190:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838195:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838201:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838206:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.838212:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788970164.838651:0:17526:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788970164.838656:0:17526:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788970164.839965:0:17526:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97786f1aaea0 - data ffff97787fdeb000/ffff977742cad400 00000020:01000000:0.0:1788970164.840087:0:17526:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977845734f00 - data ffff97785c513bd0/ffff97787fbe4c00 00000020:00000080:0.0:1788970164.842094:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ad3 00000020:00000080:0.0:1788970164.842110:0:17526:0:(genops.c:885:class_export_put()) final put ffff977880e9e000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788970164.842133:0:17526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787a5ba000 from MGS, refs=2 00000020:01000004:0.0:1788970164.842138:0:17526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787a5ba000 2 00000020:01000004:0.0:1788970164.842142:0:17526:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97787a5ba000 from MGS 00000020:00000080:0.0:1788970164.842173:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970164.842182:0:17526:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788970164.842184:0:17526:0:(genops.c:885:class_export_put()) final put ffff977880e9e800/MGS 00000020:00000080:0.0:1788970164.842187:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff977880e9e800/MGS for MGS 00000020:01000000:0.0:1788970164.842194:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788970164.842286:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788970164.842292:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.842344:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977880e9e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788970164.842380:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970164.842389:0:17526:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97784c0a1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970164.842395:0:17526:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff9778792199c0) has exports, disconnecting them 00000020:00080000:0.0:1788970164.842401:0:17526:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97784c0a1000), last request at 1788970079 00000020:00000080:0.0:1788970164.842406:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4bc1 00000020:00080000:0.0:1788970164.842413:0:17526:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97784c0a1000): rc 0 00000020:00000080:0.0:1788970164.842418:0:17526:0:(genops.c:885:class_export_put()) final put ffff97784c0a1000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788970164.843315:0:17526:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788970164.843323:0:17526:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970164.843328:0:17526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970164.843335:0:17526:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970164.845841:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c0a1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788970164.846224:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97784c249800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788970164.846518:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970164.846531:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788970164.846538:0:17526:0:(genops.c:885:class_export_put()) final put ffff97784c0a2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788970164.846542:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff97784c0a2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788970164.846616:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788970164.846773:0:17526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787a5ba000 1 00000020:00000080:0.0:1788970164.846783:0:17526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ac5 00000020:00000080:0.0:1788970164.846969:0:17526:0:(genops.c:885:class_export_put()) final put ffff977880e9f000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788970164.847015:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788970164.847154:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977880e9f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970164.847172:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.847178:0:17526:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970164.847184:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9778652f8000) has no exports 00000020:00000080:1.0:1788970164.866990:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970164.867014:0:17526:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788970164.867022:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a5be800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970164.867029:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788970164.867041:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788970164.867236:0:17526:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97787a5b9800 00000020:01000000:1.0:1788970164.867264:0:17526:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788970164.867268:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970164.867274:0:17526:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970164.867279:0:17526:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9778652fcd40) has no exports 00000100:00100000:1.0:1788970164.867370:0:14390:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff97787891f600:14390] 2 exiting: rc = 0 00000100:00100000:1.0:1788970164.867496:0:14388:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff977878585a00:14388] 0 exiting: rc = 1 00000100:00100000:1.0:1788970164.869278:0:14389:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff97787891e600:14389] 1 exiting: rc = 0 00000100:00100000:2.0:1788970164.883823:0:16264:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff97787a3ee000:16264] 3 exiting: rc = 0 00000100:00100000:1.0:1788970164.884236:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884246:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884254:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884261:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884267:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884274:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884280:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884286:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884293:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884299:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884327:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884333:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884340:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884347:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884366:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884373:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884381:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884388:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884398:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884411:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884417:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884424:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884429:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884436:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884442:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884448:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884453:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884459:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884465:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884472:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884479:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884491:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884500:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884511:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884517:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884526:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.884532:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886786:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886828:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886836:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886842:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886858:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886865:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886870:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886876:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.886898:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888481:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888507:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888514:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888521:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888527:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888534:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888613:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888623:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888637:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888645:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888712:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888722:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888729:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888735:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888742:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888753:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888759:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.888767:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.898972:0:14392:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97787f760c00:14392] 1 exiting: rc = 0 00000100:00100000:3.0:1788970164.899396:0:14391:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff977877f63600:14391] 0 exiting: rc = 1 00000100:00100000:1.0:1788970164.902192:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902208:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902224:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902232:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902238:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902245:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902251:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902257:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902263:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902269:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902275:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902282:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902288:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902294:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902301:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902307:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902338:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902344:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902413:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902420:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902427:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902434:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902440:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902447:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902452:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902458:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902463:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902469:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902475:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902481:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902487:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902493:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902499:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902504:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902511:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902517:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902523:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902529:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902535:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902541:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902614:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902621:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902627:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902632:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902639:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902644:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902651:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902657:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.902994:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903005:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903011:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903026:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903032:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903038:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903044:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903050:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903057:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903062:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903068:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903074:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903079:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903085:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903092:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.903098:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.904540:0:14393:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff977851e8d000:14393] 0 exiting: rc = 1 00000100:00100000:1.0:1788970164.905323:0:14394:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff977877f64800:14394] 1 exiting: rc = 0 00000100:00100000:2.0:1788970164.905576:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905585:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905592:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905601:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905607:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905617:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905634:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905641:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905647:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905653:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.905660:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906134:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906142:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906149:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906180:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906192:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906200:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906213:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906239:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906247:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906254:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906260:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906267:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906273:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906279:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906285:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906291:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906298:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906304:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906311:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906332:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906339:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906345:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906365:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906376:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906382:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906393:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906405:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906412:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906419:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906426:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906434:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906459:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906467:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906475:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906483:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906491:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906499:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906506:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906521:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906527:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906535:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906556:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906568:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906593:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906601:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906608:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906616:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906623:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906631:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906641:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906650:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906658:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970164.906896:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.941395:0:14395:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97787f3f5c00:14395] 0 exiting: rc = 1 00000100:00100000:2.0:1788970164.953947:0:14396:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9778452d1e00:14396] 1 exiting: rc = 0 00000100:00100000:1.0:1788970164.954139:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954151:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954157:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954162:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954168:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954173:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954179:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954186:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954191:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954197:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954203:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954209:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954214:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954221:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954228:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954234:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954239:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954244:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954249:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954254:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954286:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954292:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954298:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954303:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954309:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954315:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954320:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954326:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954331:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954336:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954342:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954349:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954353:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954359:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954364:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954370:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954375:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954381:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954386:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954392:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954397:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954403:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954409:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954415:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954421:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954426:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954433:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954440:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954445:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954450:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954455:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954461:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954465:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954470:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954475:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954491:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954497:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954503:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954509:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954515:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954520:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954526:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954531:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970164.954537:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970164.957322:0:14397:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97784370ce00:14397] 0 exiting: rc = 1 00000100:00100000:2.0:1788970164.957927:0:14398:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9778452d0000:14398] 1 exiting: rc = 0 00000100:00100000:2.0:1788970165.003100:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003112:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003118:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003124:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003129:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003134:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003140:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003146:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003152:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003158:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003163:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003169:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003174:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003180:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003186:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003193:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003198:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003204:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003232:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003239:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003245:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003251:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003257:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003264:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003269:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003274:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003279:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003285:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003291:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003297:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003303:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003309:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003315:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003321:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003327:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003333:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003339:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003346:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003352:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003359:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003366:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003372:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003378:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003384:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003390:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003396:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003402:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003408:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003414:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003420:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003426:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003432:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003437:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003451:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003456:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003462:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003467:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003472:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003477:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003482:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003488:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003494:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003499:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.003506:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970165.010317:0:14400:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9778452d1200:14400] 1 exiting: rc = 0 00000100:00100000:0.0:1788970165.011532:0:14399:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9778452d0c00:14399] 0 exiting: rc = 1 00000100:00100000:2.0:1788970165.012156:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012166:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012173:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012179:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012185:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012195:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012200:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012206:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012213:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012218:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012225:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012230:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012236:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012241:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012247:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012252:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012257:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012264:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012269:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012275:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012280:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012285:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012289:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012295:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012316:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012321:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012327:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012333:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012338:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012344:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012349:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012355:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012361:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012367:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012373:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012380:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012386:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012392:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012398:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012404:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012410:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012415:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012419:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012425:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012430:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012435:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012442:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012447:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012452:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012456:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012461:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012467:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012472:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012478:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012483:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012489:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012494:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012499:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012505:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012519:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012524:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012528:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012534:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.012539:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.013251:0:14401:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff97787f475000:14401] 0 exiting: rc = 1 00000100:00100000:2.0:1788970165.013498:0:14403:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff97786510ae00:14403] 2 exiting: rc = 0 00000100:00100000:3.0:1788970165.014293:0:14402:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff97787f475e00:14402] 1 exiting: rc = 0 00000100:00100000:2.0:1788970165.040049:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040063:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040072:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040079:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040087:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040093:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040102:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040110:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040117:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040124:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040159:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040167:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040174:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040180:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040187:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040193:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040200:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040207:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040213:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040219:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040226:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040232:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040238:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040244:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040251:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040258:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040264:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040274:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040303:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040309:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040315:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040322:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040331:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040339:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040361:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040369:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040376:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040383:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040390:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040397:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040403:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040410:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040416:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040422:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040428:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040434:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040442:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040449:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040456:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040462:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040469:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040483:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040490:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040497:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040503:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040509:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040515:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040522:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040528:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040535:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040541:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040547:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040565:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970165.040581:0:17526:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788970165.058015:0:17526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970165.058034:0:17526:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788970165.058042:0:17526:0:(genops.c:885:class_export_put()) final put ffff97787a5bd000/MDS_uuid 00000020:00000080:2.0:1788970165.058048:0:17526:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5bd000/MDS_uuid for MDS 00000020:01000000:2.0:1788970165.058063:0:17526:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788970165.058277:0:17526:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788970165.511484:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970166.533115:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970167.557330:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970168.582624:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970169.212048:0:17677:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788970169.220912:0:17677:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788970169.220959:0:17677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970169.220972:0:17677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970169.220977:0:17677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970169.220983:0:17677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970169.220997:0:17677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788970169.221001:0:17677:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788970169.221017:0:17677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970169.221020:0:17677:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788970169.221024:0:17677:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788970169.221044:0:17677:0:(import.c:65:import_set_state_nolock()) ffff97787f5ef800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788970169.221110:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970169.221116:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970169.221121:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970169.221124:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970169.221130:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970169.221149:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970169.221153:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970169.221154:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788970169.221156:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788970169.221178:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970169.221182:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970169.221204:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970169.221211:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b4c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d0de860b05b4c4d expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970169.221222:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970169.221224:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970169.221225:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788970169.221226:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970169.221242:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741542528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970169.221306:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970169.221693:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741542400:0@lo:39:umount.0 00000400:00000100:0.0:1788970169.221712:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741542400 offset 0 length 224: 4 00000100:00100000:3.0:1788970169.221779:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741542528 00000100:00100000:3.0:1788970169.221785:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741542528 00000100:00100000:3.0:1788970169.221850:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970169.221934:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875870741542528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788970169.221941:0:14373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970169 with bad export cookie 6705270922197813999 00000100:00100000:3.0:1788970169.227223:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875870741542528:12345-0@lo:103:ldlm_bl.0 Request processed in 5360us (5912us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970169.227235:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788970169.227293:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788970169.227299:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788970169.227303:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788970169.231343:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.109@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788970169.231349:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788970169.231358:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97784eb8ed00 x1875870741542528/t0(0) o103->MGC192.168.202.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970185 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788970169.231371:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788970169.231374:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788970169.231376:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788970169.231380:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970169.231384:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 391 00000100:00080000:2.0:1788970169.231399:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import ffff9778508e9000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970169.231430:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e21c0 x1875870741542656/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970169.231461:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:de37645b-91a3-4bf2-a071-03e750936262:3283:1875870741542528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970169.231765:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741542656:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788970169.231866:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875870741542656 offset 0 length 520: 4 00000100:00100000:3.0:1788970169.285101:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741542784:0@lo:400:kworker.0 00000400:00000100:3.0:1788970169.285173:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741542784 offset 0 length 224: 4 00000001:00100000:3.0:1788970169.306732:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970169.306742:0:7615:0:(genops.c:885:class_export_put()) final put ffff9778798bf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788970169.306866:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9778798bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788970169.306921:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778798b9000 for lustre-OST0001 00010000:00010000:2.0:1788970169.605041:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970170.629029:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970171.654723:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970172.677092:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970173.703987:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970174.404943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970174.404957:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970174.405123:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970174.405153:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741542912:0@lo:400:kworker.0 00000400:00000100:2.0:1788970174.405228:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741542912 offset 0 length 224: 4 00010000:00010000:3.0:1788970174.725117:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970175.749032:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970176.773334:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970177.802545:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970178.821553:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970179.524925:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970169/real 1788970169] req@ffff9778812e21c0 x1875870741542656/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970179.524966:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9778812e21c0 x1875870741542656/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970179.524977:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970169/real 1788970169] req@ffff97787ff64b40 x1875870741542400/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970179.525003:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787ff64b40 x1875870741542400/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970179.525022:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970179.525155:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788970179.525160:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741542656:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788970179.525167:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f5ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970179.525176:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741542400:0@lo:39:umount.0 00000100:00080000:2.0:1788970179.525250:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970179.525255:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788970179.525258:0:38:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970179.525262:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 481 00000100:00080000:2.0:1788970179.525267:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.109@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788970179.525289:0:38:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import ffff9778508e9000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970179.525327:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e3480 x1875870741543040/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970179.525385:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741543168:0@lo:400:kworker.0 00000400:00000100:2.0:1788970179.525462:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741543168 offset 0 length 224: 4 00000100:00080000:0.0:1788970179.525552:0:17677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970179.525556:0:17677:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788970179.525561:0:17677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788970179.525754:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741543040:0@lo:250:kworker.0 00000400:00000100:1.0:1788970179.525775:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875870741543040 offset 0 length 520: 4 00010000:00010000:0.0:1788970179.526734:0:17677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.526749:0:17677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.526757:0:17677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.526764:0:17677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.526816:0:17677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970179.526823:0:17677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970179.527093:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970179.527101:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970179.527109:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f44c600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970179.527113:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970179.527122:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970179.527129:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970179.527134:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970179.527136:0:14376:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788970179.527147:0:14376:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:3.0:1788970179.527151:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970179.527177:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44c600/0x5d0de860b05b4c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4c23 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970179.527192:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970179.527194:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970179.527195:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970179.528763:0:17677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.528777:0:17677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.528783:0:17677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970179.528839:0:17677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788970179.528844:0:17677:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788970179.528849:0:17677:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788970179.528873:0:17677:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788970179.528878:0:17677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788970179.528883:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970179.528888:0:17677:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970179.528891:0:17677:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff977850050000) has no exports 00000020:00080000:0.0:1788970179.528916:0:17677:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff977850050000) has no exports 00000020:01000000:0.0:1788970179.530585:0:17677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977851f8dcc0 - data ffff9777416056c0/ffff977742270800 00010000:00010000:2.0:1788970179.531647:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970179.531659:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970179.531671:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970179.531677:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970179.531687:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970179.531695:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970179.531736:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788970179.531738:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788970179.531741:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788970179.531758:0:14377:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:2.0:1788970179.531762:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970179.531768:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5e00/0x5d0de860b05b4f1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4f25 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970179.531780:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970179.531782:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970179.531783:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788970179.534708:0:17677:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977878e279c0 - data ffff97785c771ca8/ffff97787a2a8400 00100000:10000000:0.0:1788970179.559286:0:17677:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788970179.599138:0:17677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4c31 00000020:00000080:0.0:1788970179.599157:0:17677:0:(genops.c:885:class_export_put()) final put ffff97786df73000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788970179.599183:0:17677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787f5e8000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788970179.599188:0:17677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787f5e8000 2 00000020:01000004:0.0:1788970179.599192:0:17677:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97787f5e8000 from lustre-OST0000 00000020:00000080:0.0:1788970179.599236:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970179.599246:0:17677:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788970179.599249:0:17677:0:(genops.c:885:class_export_put()) final put ffff97786df71000/lustre-OST0000_UUID 00000020:00000080:0.0:1788970179.599252:0:17677:0:(genops.c:844:class_export_destroy()) destroying export ffff97786df71000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788970179.599259:0:17677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788970179.599491:0:17677:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788970179.599497:0:17677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788970179.599501:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970179.599507:0:17677:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970179.599513:0:17677:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97787a250000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970179.599519:0:17677:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff977879a88000) has exports, disconnecting them 00000020:00080000:0.0:1788970179.599525:0:17677:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97787a250000), last request at 1788970092 00000020:00000080:0.0:1788970179.599549:0:17677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4c5b 00000020:00080000:0.0:1788970179.599560:0:17677:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787a250000): rc 0 00000020:00000080:0.0:1788970179.599565:0:17677:0:(genops.c:885:class_export_put()) final put ffff97787a250000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788970179.599733:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97786df73000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788970179.599750:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a250000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788970179.602390:0:17677:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788970179.602399:0:17677:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970179.602403:0:17677:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970179.602410:0:17677:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970179.602565:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970179.602575:0:17677:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788970179.602582:0:17677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787f5e8000 1 00000020:00000080:0.0:1788970179.602589:0:17677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4c00 00000020:00000080:0.0:1788970179.602599:0:17677:0:(genops.c:885:class_export_put()) final put ffff97787f5e8800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788970179.602605:0:17677:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788970179.602609:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970179.602614:0:17677:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788970179.602618:0:17677:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9778652fb380) has no exports 00000020:00000080:3.0:1788970179.604254:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97787f5ef800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788970179.604269:0:38:0:(genops.c:885:class_export_put()) final put ffff9778816fc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788970179.604272:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9778816fc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788970179.604285:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788970179.604353:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f5e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788970179.650189:0:17677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970179.650209:0:17677:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788970179.650227:0:17677:0:(genops.c:885:class_export_put()) final put ffff97787f5eb800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788970179.650234:0:17677:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f5eb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788970179.650245:0:17677:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788970179.650392:0:17677:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97787f5e9800 00000020:02000400:0.0:1788970179.650440:0:17677:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788970179.862892:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970180.870185:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970181.892938:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970182.723673:0:17830:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788970182.742015:0:17830:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788970182.742094:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.742123:0:17830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.742145:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.742152:0:17830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970182.742175:0:17830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788970182.742190:0:17830:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788970182.742213:0:17830:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970182.742225:0:17830:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e0b40 x1875870741542784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970185 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970182.742352:0:17830:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97787dce6d00 x1875870741542912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970190 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970182.742362:0:17830:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e21c0 x1875870741543168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970182.742386:0:17830:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788970182.742393:0:17830:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788970182.742420:0:17830:0:(import.c:65:import_set_state_nolock()) ffff977845011800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788970182.742434:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741543168:0@lo:400:kworker.0 00000100:00100000:1.0:1788970182.742446:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741543296:0@lo:39:umount.0 00000400:00000100:1.0:1788970182.742495:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875870741543296 offset 0 length 224: 4 00010000:00010000:2.0:1788970182.742862:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970182.742870:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970182.742880:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970182.742883:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970182.742893:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970182.742901:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970182.742906:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970182.742918:0:14377:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788970182.742920:0:14377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788970182.742933:0:14377:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:2.0:1788970182.742937:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970182.742944:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5a00/0x5d0de860b05b4d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4d88 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970182.742955:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970182.742956:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970182.742958:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970182.743455:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741542784:0@lo:400:kworker.0 00000100:00100000:3.0:1788970182.743476:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875870741542912:0@lo:400:kworker.0 00010000:00010000:0.0:1788970182.916942:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970183.941956:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970184.644959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970184.644979:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788970184.967893:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970185.994557:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970187.013424:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970188.037173:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970189.063294:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970189.765483:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970189.765494:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) de37645b-91a3-4bf2-a071-03e750936262->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788970190.085288:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970191.109034:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970192.133641:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970192.966425:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970182/real 1788970182] req@ffff97787ff64b40 x1875870741543296/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970192.966468:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787ff64b40 x1875870741543296/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970192.966489:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977845011800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970192.966606:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741543296:0@lo:39:umount.0 00000100:00080000:3.0:1788970192.966714:0:17830:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970192.966719:0:17830:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970192.966724:0:17830:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970192.967777:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.967823:0:17830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.967830:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.967837:0:17830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.969324:0:17830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970192.969341:0:17830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.969351:0:17830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.969356:0:17830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970192.969361:0:17830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980298:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970192.980315:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980329:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970192.980334:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980346:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970192.980353:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970192.980360:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970192.980363:0:14376:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788970192.980377:0:14376:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:0.0:1788970192.980381:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980388:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977852ff5c00/0x5d0de860b05b4d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4d5e expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980408:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970192.980414:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980420:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970192.980441:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980449:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970192.980455:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970192.980460:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788970192.980462:0:14376:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788970192.980467:0:14376:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:0.0:1788970192.980470:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970192.980478:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970192.980480:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970192.980483:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970192.980645:0:17830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970192.980654:0:17830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b4f10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4f17 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970192.980670:0:17830:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788970192.980676:0:17830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788970192.980679:0:17830:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788970192.980706:0:17830:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788970192.980711:0:17830:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788970192.980736:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970192.980744:0:17830:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970192.980749:0:17830:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff977879218000) has no exports 00000020:00080000:3.0:1788970192.980776:0:17830:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff977879218000) has no exports 00010000:00010000:2.0:1788970192.981270:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788970192.988393:0:17830:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff977852c2ec00 - data ffff97786ee85360/ffff97784ef2e000 00000020:01000000:3.0:1788970192.988568:0:17830:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97787f74b300 - data ffff9777416041b0/ffff977742274400 00100000:10000000:3.0:1788970193.010528:0:17830:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788970193.090349:0:17830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4d6c 00000020:00000080:1.0:1788970193.090360:0:17830:0:(genops.c:885:class_export_put()) final put ffff9778816fa800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788970193.090376:0:17830:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97786df72000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788970193.090380:0:17830:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786df72000 2 00000020:01000004:1.0:1788970193.090383:0:17830:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97786df72000 from lustre-OST0001 00000020:00000080:1.0:1788970193.090408:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970193.090417:0:17830:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788970193.090420:0:17830:0:(genops.c:885:class_export_put()) final put ffff9778816fe800/lustre-OST0001_UUID 00000020:00000080:1.0:1788970193.090422:0:17830:0:(genops.c:844:class_export_destroy()) destroying export ffff9778816fe800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788970193.090430:0:17830:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788970193.090521:0:17830:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import de37645b-91a3-4bf2-a071-03e750936262->MGS 00010000:00010000:1.0:1788970193.090538:0:17830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970193.090553:0:17830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970193.090559:0:17830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788970193.090562:0:17830:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788970193.090565:0:17830:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788970193.090598:0:17830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:1.0:1788970193.090602:0:17830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44c200/0x5d0de860b05b4c0e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4c15 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970193.090616:0:17830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970193.090622:0:17830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970193.090643:0:17830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970193.090646:0:17830:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788970193.090647:0:17830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788970193.090657:0:17830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9778508e9000 00010000:00010000:1.0:1788970193.090660:0:17830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f44d800/0x5d0de860b05b4af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d0de860b05b4afd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970193.090675:0:17830:0:(import.c:65:import_set_state_nolock()) ffff9778508e9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788970193.090679:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788970193.090681:0:17830:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788970193.090682:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788970193.090687:0:17830:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788970193.090698:0:17830:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9778812e3480 x1875870741543040/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788970194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788970193.090774:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788970193.090778:0:17830:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:3.0:1788970193.090857:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9778816fa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788970193.097573:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:de37645b-91a3-4bf2-a071-03e750936262:3282:1875870741543040:0@lo:250:kworker.0 10000000:01000000:1.0:1788970193.097699:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788970193.097714:0:17830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4ae1 00000020:00000080:1.0:1788970193.097723:0:17830:0:(genops.c:885:class_export_put()) final put ffff97787a5ba800/de37645b-91a3-4bf2-a071-03e750936262 00000020:01000000:1.0:1788970193.097744:0:17830:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.109@tcp (flags='') 00000020:00000080:1.0:1788970193.097754:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970193.097762:0:17830:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970193.097766:0:17830:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9778652a99c0) has no exports 00000020:00000080:3.0:1788970193.097856:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a5ba800/de37645b-91a3-4bf2-a071-03e750936262 for MGC192.168.202.109@tcp 10000000:01000000:0.0:1788970193.097914:0:14385:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788970193.098417:0:17830:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.109@tcp: client import never connected 00000100:00080000:1.0:1788970193.098423:0:17830:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788970193.098426:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788970193.098429:0:17830:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788970193.098431:0:17830:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788970193.098489:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970193.098496:0:17830:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.109@tcp (uuid de37645b-91a3-4bf2-a071-03e750936262) 00000020:01000000:1.0:1788970193.098504:0:17830:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788970193.098517:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970193.098522:0:17830:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788970193.098527:0:17830:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97787a255000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970193.098533:0:17830:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff977741980000) has exports, disconnecting them 00000020:00080000:1.0:1788970193.098538:0:17830:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97787a255000), last request at 1788970107 00000020:00000080:1.0:1788970193.098542:0:17830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4d96 00000020:00080000:1.0:1788970193.098553:0:17830:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97787a255000): rc 0 00000020:00000080:1.0:1788970193.098557:0:17830:0:(genops.c:885:class_export_put()) final put ffff97787a255000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970193.099281:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9778508e9000 for MGC192.168.202.109@tcp 00000020:00000080:3.0:1788970193.099293:0:38:0:(genops.c:885:class_export_put()) final put ffff977855c5e000/de37645b-91a3-4bf2-a071-03e750936262 00000020:00000080:3.0:1788970193.099296:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977855c5e000/de37645b-91a3-4bf2-a071-03e750936262 for MGC192.168.202.109@tcp 00000020:01000000:3.0:1788970193.099303:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.109@tcp (de37645b-91a3-4bf2-a071-03e750936262) 00000020:00000080:3.0:1788970193.099544:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff97787a255000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788970193.105008:0:17830:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788970193.105018:0:17830:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970193.105023:0:17830:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970193.105032:0:17830:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788970193.105108:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788970193.107340:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788970193.107675:0:14371:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff977850c9cc00:14371] 0 exiting: rc = 1 00000020:00000080:3.0:1788970193.112386:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff977845011800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1788970193.113949:0:14372:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff977850c9ce00:14372] 1 exiting: rc = 0 00000100:00100000:0.0:1788970193.114716:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.115344:0:14375:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff977850c9de00:14375] 2 exiting: rc = 0 00000100:00100000:3.0:1788970193.115436:0:14373:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff977850c9c200:14373] 0 exiting: rc = 1 00000100:00100000:3.0:1788970193.116938:0:14374:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff977850c9d800:14374] 1 exiting: rc = 0 00000100:00100000:0.0:1788970193.117064:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117073:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117079:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117084:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117128:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117133:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117138:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117144:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117157:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117164:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117168:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117174:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117179:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117183:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117189:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117195:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117199:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117204:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117209:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117215:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117220:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117225:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117230:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117235:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117240:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117244:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117249:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117254:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117258:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117264:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117268:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117273:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117279:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117285:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117290:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117295:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117300:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117304:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117309:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117321:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117327:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117332:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117337:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117342:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117347:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117351:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117356:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117361:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117367:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117373:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117377:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117382:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117388:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117393:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117397:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117402:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117407:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117412:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117417:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117422:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117427:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117432:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117438:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.117443:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788970193.118392:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970193.118403:0:17830:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970193.118409:0:17830:0:(genops.c:885:class_export_put()) final put ffff9778816fe000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788970193.118414:0:17830:0:(genops.c:844:class_export_destroy()) destroying export ffff9778816fe000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788970193.118421:0:17830:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788970193.118461:0:17830:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97786df72000 1 00000020:00000080:3.0:1788970193.118467:0:17830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5d0de860b05b4d50 00000020:00000080:3.0:1788970193.118472:0:17830:0:(genops.c:885:class_export_put()) final put ffff977878a7e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788970193.118485:0:17830:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788970193.118497:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff977878a7e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788970193.118508:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970193.118513:0:17830:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970193.118516:0:17830:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9778500519c0) has no exports 00000020:00000080:3.0:1788970193.149133:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970193.149295:0:17830:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788970193.149302:0:17830:0:(genops.c:885:class_export_put()) final put ffff97786df77000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788970193.149306:0:17830:0:(genops.c:844:class_export_destroy()) destroying export ffff97786df77000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788970193.149315:0:17830:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788970193.149527:0:17830:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97786df70800 00000020:01000000:3.0:1788970193.149549:0:17830:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788970193.149553:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970193.149557:0:17830:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970193.149561:0:17830:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff977879a899c0) has no exports 00000020:00000080:3.0:1788970193.149598:0:17830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970193.149605:0:17830:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788970193.149607:0:17830:0:(genops.c:885:class_export_put()) final put ffff97787f5ea800/OSS_uuid 00000020:00000080:3.0:1788970193.149610:0:17830:0:(genops.c:844:class_export_destroy()) destroying export ffff97787f5ea800/OSS_uuid for OSS 00000020:01000000:3.0:1788970193.149613:0:17830:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788970193.150126:0:14384:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788970193.150267:0:15074:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff97787f77ac00:15074] 2 exiting: rc = 0 00000100:00100000:2.0:1788970193.150564:0:15654:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9778792c7000:15654] 3 exiting: rc = 0 00000100:00100000:0.0:1788970193.165511:0:15073:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff97787f7d9e00:15073] 1 exiting: rc = 0 00000100:00100000:0.0:1788970193.165636:0:15072:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff97787f7d9600:15072] 0 exiting: rc = 1 00000100:00100000:0.0:1788970193.175890:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175905:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175910:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175915:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175921:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175926:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175931:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175937:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175957:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175962:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175968:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175973:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175978:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175983:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175988:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175993:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.175997:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176002:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176007:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176012:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176016:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176021:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176025:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176030:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176035:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176041:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176046:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176051:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176056:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176060:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176065:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176071:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176076:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176081:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176100:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176105:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176109:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176114:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176254:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176263:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176269:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176279:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176284:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176298:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176303:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176308:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176313:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176319:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176324:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176330:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176336:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176342:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176347:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176353:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176358:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176363:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176368:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176373:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176378:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176383:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176389:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176395:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176400:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.176405:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970193.181095:0:15077:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff977865009200:15077] 1 exiting: rc = 0 00000100:00100000:2.0:1788970193.181562:0:15075:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff977865009e00:15075] 0 exiting: rc = 1 00000100:00100000:0.0:1788970193.185235:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185245:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185250:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185255:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185260:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185266:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185270:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185276:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185281:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185286:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185290:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185296:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185301:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185305:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185329:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185335:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185340:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185345:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185350:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185355:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185372:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185379:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185384:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185390:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185395:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185399:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185404:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185410:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185414:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185419:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185425:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185430:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185434:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185441:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185445:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185452:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185457:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185462:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185468:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185472:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185477:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185482:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185487:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185492:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185497:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185502:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185506:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185511:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185517:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185530:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185535:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185540:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185550:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185562:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185569:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185575:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185580:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185597:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185603:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185608:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185613:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185618:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185623:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.185629:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970193.187310:0:15079:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97784ea19000:15079] 1 exiting: rc = 0 00000100:00100000:0.0:1788970193.189479:0:15078:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff977847fda600:15078] 0 exiting: rc = 1 00000100:00100000:0.0:1788970193.190697:0:15080:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff977852d79200:15080] 2 exiting: rc = 0 00000100:00100000:3.0:1788970193.190852:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190862:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190869:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190875:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190881:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190886:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190892:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190917:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190924:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190931:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190938:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190944:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190950:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190956:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190962:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190968:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190974:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190979:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190985:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190990:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.190997:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191003:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191009:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191014:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191019:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191036:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191042:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191048:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191054:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191060:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191067:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191088:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191096:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191102:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191108:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191113:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191133:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191139:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191216:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191226:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191232:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191238:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191244:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191249:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191255:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191262:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191267:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191273:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191279:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191284:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191292:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191297:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191302:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191307:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191313:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191318:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191324:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191346:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191354:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191359:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191372:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191378:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191384:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.191389:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199689:0:15082:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97784ea18800:15082] 1 exiting: rc = 0 00000100:00100000:3.0:1788970193.199845:0:15081:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97784ea18e00:15081] 0 exiting: rc = 1 00000100:00100000:3.0:1788970193.199899:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199906:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199911:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199916:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199921:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199926:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199931:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199937:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199941:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199945:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199950:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199956:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199961:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199966:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199970:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199975:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199979:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199983:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199988:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199993:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.199997:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200002:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200006:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200011:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200015:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200019:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200023:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200028:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200033:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200052:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200056:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200061:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200066:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200072:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200130:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200137:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.200142:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201428:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201444:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201449:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201454:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201459:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201464:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201469:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201473:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201478:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201483:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201487:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201493:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201501:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201507:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201512:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201518:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201523:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201527:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201533:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201538:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201544:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201549:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201555:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201560:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201565:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201570:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.201575:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970193.203363:0:15083:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97784ea19e00:15083] 0 exiting: rc = 1 00000100:00100000:1.0:1788970193.205968:0:15084:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff977880c66200:15084] 1 exiting: rc = 0 00000100:00100000:0.0:1788970193.208540:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208567:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208603:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208613:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208620:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208626:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208634:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208641:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208648:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208655:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208661:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208668:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208674:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208681:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208703:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208709:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208717:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208723:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208745:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208751:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208758:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208765:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208771:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208777:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208783:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208810:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208832:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208839:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208845:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208851:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208857:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208864:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208871:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208877:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208883:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208902:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208908:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208913:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208934:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208943:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208951:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208958:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208963:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208969:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208974:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208980:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208985:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208991:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.208997:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209002:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209021:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209028:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209033:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209046:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209052:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209057:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209062:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209068:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209082:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209110:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209133:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209141:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209340:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970193.209350:0:17830:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788970193.228784:0:17830:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788970210.313437:0:18446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788970220.267513:0:18907:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788970220.267518:0:18907:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788970220.267625:0:18907:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97787ef4d000 00000020:01000004:0.0:1788970220.267641:0:18907:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788970220.267648:0:18907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788970220.267661:0:18907:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff977741983380) 00000020:00000080:0.0:1788970220.267674:0:18907:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788970220.286026:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788970220.292111:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788970220.292494:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 563: rc = 0 00100000:10000000:0.0:1788970220.293564:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788970220.293866:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 563: rc = 0 00100000:10000000:0.0:1788970220.295617:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 563: rc = 0 00100000:10000000:0.0:1788970220.295859:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 563: rc = 0 00100000:10000000:0.0:1788970220.298054:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 563: rc = 0 00100000:10000000:0.0:1788970220.298252:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 563: rc = 0 00100000:10000000:0.0:1788970220.300819:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 565: rc = 0 00100000:10000000:0.0:1788970220.301855:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 775: rc = 0 00100000:10000000:0.0:1788970220.301946:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 775: rc = 0 00100000:10000000:0.0:1788970220.302427:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.302665:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 278: rc = 0 00100000:10000000:0.0:1788970220.302938:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 278: rc = 0 00100000:10000000:0.0:1788970220.303183:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.304277:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.304576:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 278: rc = 0 00100000:10000000:0.0:1788970220.305198:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 278: rc = 0 00100000:10000000:0.0:1788970220.305488:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.306251:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 278: rc = 0 00100000:10000000:0.0:1788970220.306676:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.307131:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 278: rc = 0 00100000:10000000:0.0:1788970220.307413:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 278: rc = 0 00100000:10000000:0.0:1788970220.307879:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 405: rc = 0 00100000:10000000:0.0:1788970220.308631:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 405: rc = 0 00100000:10000000:0.0:1788970220.309129:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 405: rc = 0 00100000:10000000:0.0:1788970220.309402:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 405: rc = 0 00100000:10000000:0.0:1788970220.309860:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 405: rc = 0 00100000:10000000:0.0:1788970220.310253:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 405: rc = 0 00100000:10000000:0.0:1788970220.312146:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 405: rc = 0 00100000:10000000:0.0:1788970220.313172:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 405: rc = 0 00100000:10000000:0.0:1788970220.313447:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 405: rc = 0 00100000:10000000:0.0:1788970220.315432:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 405: rc = 0 00100000:10000000:0.0:1788970220.317150:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 405: rc = 0 00100000:10000000:0.0:1788970220.317446:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 405: rc = 0 00100000:10000000:0.0:1788970220.319265:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 405: rc = 0 00100000:10000000:0.0:1788970220.320058:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 405: rc = 0 00100000:10000000:0.0:1788970220.320317:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 405: rc = 0 00100000:10000000:0.0:1788970220.320590:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 405: rc = 0 00100000:10000000:0.0:1788970220.320877:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 405: rc = 0 00100000:10000000:0.0:1788970220.321165:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 405: rc = 0 00100000:10000000:0.0:1788970220.321437:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 405: rc = 0 00100000:10000000:0.0:1788970220.321714:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 405: rc = 0 00100000:10000000:0.0:1788970220.322012:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 405: rc = 0 00100000:10000000:0.0:1788970220.322260:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 405: rc = 0 00100000:10000000:1.0:1788970220.324618:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 405: rc = 0 00100000:10000000:1.0:1788970220.324910:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 405: rc = 0 00100000:10000000:1.0:1788970220.325156:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 405: rc = 0 00100000:10000000:1.0:1788970220.325389:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 405: rc = 0 00100000:10000000:1.0:1788970220.325596:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 405: rc = 0 00100000:10000000:1.0:1788970220.325852:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 405: rc = 0 00100000:10000000:1.0:1788970220.326083:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 405: rc = 0 00100000:10000000:1.0:1788970220.326325:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 405: rc = 0 00100000:10000000:1.0:1788970220.326589:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 405: rc = 0 00100000:10000000:1.0:1788970220.326862:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 405: rc = 0 00100000:10000000:2.0:1788970220.327277:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 781: rc = 0 00100000:10000000:2.0:1788970220.329311:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788970220.329506:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 776: rc = 0 00100000:10000000:2.0:1788970220.332278:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788970220.332403:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 776: rc = 0 00100000:10000000:3.0:1788970220.336270:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788970220.336606:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 776: rc = 0 00100000:10000000:3.0:1788970220.337415:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788970220.337594:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 274: rc = 0 00100000:10000000:3.0:1788970220.339163:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788970220.339255:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 274: rc = 0 00100000:10000000:3.0:1788970220.340643:0:18907:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788970220.341296:0:18907:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 274: rc = 0 00000020:00000080:3.0:1788970220.341605:0:18907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788970220.341616:0:18907:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788970220.341627:0:18907:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b5227 00000020:01000004:3.0:1788970220.341635:0:18907:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788970220.341640:0:18907:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788970220.341646:0:18907:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787ef4d000 from MGS 00000020:01000004:3.0:1788970220.342033:0:18907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788970220.342046:0:18907:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9778500519c0) 00000020:00000080:3.0:1788970220.342058:0:18907:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788970220.342114:0:18907:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787ef4d000 from MGS, refs=2 00080000:01000000:3.0:1788970220.342119:0:18907:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970220.342124:0:18907:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b5235 00000100:00100000:3.0:1788970220.342233:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788970220.342381:0:18907:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788970220.342387:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788970220.343249:0:18907:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788970220.343256:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788970220.345207:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970220.345404:0:18907:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788970220.345410:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788970220.346551:0:18907:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788970220.346561:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788970220.347047:0:18907:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788970220.347053:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788970220.347942:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970220.347946:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970220.347947:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970220.348714:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970220.348717:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970220.348719:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970220.355173:0:18907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788970220.358498:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788970220.369598:0:18907:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788970220.369618:0:18907:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788970220.369620:0:18907:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788970220.374701:0:18916:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788970220.375005:0:18907:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788970220.375144:0:18907:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788970220.375648:0:18907:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788970220.376013:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970220.376158:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788970220.376164:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788970220.390871:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788970220.390889:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788970220.393506:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788970220.393519:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788970220.394552:0:18921:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788970220.394686:0:18907:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788970220.394710:0:18907:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.109@tcp' 00000020:01000004:0.0:1788970220.394712:0:18907:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788970220.394741:0:18907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.109@tcp (typ=mgc) 00000020:00000080:0.0:1788970220.394753:0:18907:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.109@tcp (ffff977741984d40) 00000020:00000080:0.0:1788970220.394774:0:18907:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788970220.395241:0:18907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff977844fc3000@MGC192.168.202.109@tcp: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970220.395400:0:18907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.109@tcp-0 is initialized 00000040:01000000:0.0:1788970220.395406:0:18907:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788970220.396101:0:18922:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788970220.396170:0:18907:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.109@tcp (uuid 629abde5-c42a-46d1-8386-6aff8bcfd1f0) 00000020:00000080:0.0:1788970220.396186:0:18907:0:(genops.c:1384:class_connect()) connect: client 629abde5-c42a-46d1-8386-6aff8bcfd1f0, cookie 0x5d0de860b05b5243 00000100:00080000:0.0:1788970220.396199:0:18907:0:(import.c:545:import_select_connection()) MGC192.168.202.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970220.396207:0:18907:0:(import.c:666:import_select_connection()) MGC192.168.202.109@tcp: import ffff977844fc3000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970220.396240:0:18907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce7c00 x1875870741543424/t0(0) o250->MGC192.168.202.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970220.396272:0:18907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 629abde5-c42a-46d1-8386-6aff8bcfd1f0->MGS 00000020:01000004:0.0:1788970220.396294:0:18907:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788970220.396299:0:18907:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788970220.396312:0:18907:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9777419819c0) 00000020:00000080:0.0:1788970220.396322:0:18907:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788970220.399148:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3282:1875870741543424:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788970220.399224:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.399634:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741543424 00000100:00100000:3.0:1788970220.399643:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741543424 00000100:00100000:3.0:1788970220.399680:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970220.399687:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875870741543424:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788970220.399712:0:18917:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 629abde5-c42a-46d1-8386-6aff8bcfd1f0@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:3.0:1788970220.399737:0:18917:0:(genops.c:1384:class_connect()) connect: client 629abde5-c42a-46d1-8386-6aff8bcfd1f0, cookie 0x5d0de860b05b5251 00000100:00080000:3.0:1788970220.399891:0:18917:0:(import.c:65:import_set_state_nolock()) ffff9777413e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970220.399958:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:3282:x1875870741543424:12345-0@lo:250:mount.lustre.0 Request processed in 270us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.399965:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970220.400006:0:3282:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788970220.400013:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.109@tcp: connect to target with instance 0 00000100:00080000:3.0:1788970220.400020:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788970220.400024:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788970220.400028:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977844fc3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788970220.400030:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788970220.400036:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788970220.400041:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3282:1875870741543424:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788970220.417840:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970220.418054:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970220.418060:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788970220.418735:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970220.418743:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788970220.421827:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788970220.421849:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788970220.426939:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970220.427192:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788970220.427198:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788970220.432351:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788970220.432364:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788970220.497726:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970220.497952:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788970220.497958:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788970220.509025:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788970220.509042:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788970220.510837:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970220.511022:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970220.511029:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788970220.511856:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970220.511864:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788970220.512321:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970220.512597:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788970220.512602:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788970220.516750:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788970220.516762:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788970220.525461:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970220.525644:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788970220.525650:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788970220.530102:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788970220.530116:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788970220.584107:0:18907:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970220.585672:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970220.585681:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788970220.588248:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788970220.588262:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788970220.607681:0:18907:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788970220.607702:0:18907:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788970220.612735:0:18907:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788970220.613106:0:18907:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788970220.613113:0:18907:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970220.617082:0:18907:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970220.617131:0:18907:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788970220.617136:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970220.617138:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970220.617139:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970220.617140:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970220.617141:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970220.617142:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970220.617144:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970220.617145:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970220.617147:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970220.617149:0:18907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970220.617152:0:18907:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788970220.617154:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970220.617156:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970220.617157:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970220.617158:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970220.617159:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970220.617160:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970220.617161:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970220.617162:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970220.617163:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970220.617165:0:18907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970220.617195:0:18907:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788970220.617216:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543552:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970220.617315:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.617388:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.619040:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741543552 00000100:00100000:2.0:1788970220.619053:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741543552 00000100:00100000:2.0:1788970220.619113:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970220.619123:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:18907:x1875870741543552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970220.619165:0:18920:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788970220.619168:0:18920:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788970220.619171:0:18920:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788970220.619862:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788970220.620339:0:18920:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:2.0:1788970220.622123:0:18942:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788970220.622130:0:18942:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788970220.622132:0:18942:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788970220.622163:0:18942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788970220.622682:0:18920:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788970220.622694:0:18920:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788970220.631400:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:18907:x1875870741543552:12345-0@lo:253:mount.lustre.0 Request processed in 12263us (14069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.631422:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970220.631614:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970220.631635:0:18907:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788970220.631638:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970220.631640:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788970220.631642:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970220.631644:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970220.631645:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970220.631647:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970220.631648:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970220.631650:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788970220.631652:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970220.631653:0:18907:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788970220.631681:0:18907:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787ef4d000 from lustre-MDT0000 10000000:01000000:1.0:1788970220.631816:0:18907:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788970220.631821:0:18907:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788970220.631896:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff977741984d40 10000000:01000000:1.0:1788970220.631904:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788970220.631917:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff977741984d40 from 1 10000000:01000000:1.0:1788970220.631920:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788970220.632073:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.632175:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.632187:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.632213:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970220.632264:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.632376:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76180 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.632504:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741543680 00000100:00100000:2.0:1788970220.632513:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741543680 00000100:00100000:2.0:1788970220.632657:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970220.632669:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:18907:x1875870741543680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970220.632686:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970220.636058:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031600/0x5d0de860b05b525f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5258 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.636439:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031600/0x5d0de860b05b525f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5258 expref: 6 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.636458:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031600/0x5d0de860b05b525f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5258 expref: 6 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.636493:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031600, rc 0) 00000100:00100000:2.0:1788970220.636693:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+6:18907:x1875870741543680:12345-0@lo:101:mount.lustre.0 Request processed in 4024us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.638222:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970220.638503:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970220.638538:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.638554:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970220.638661:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970220.638748:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.638824:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.639201:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741543808 00000100:00100000:2.0:1788970220.639211:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741543808 00000100:00100000:2.0:1788970220.639267:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970220.639279:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+6:18907:x1875870741543808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970220.639631:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+6:18907:x1875870741543808:12345-0@lo:501:mount.lustre.0 Request processed in 353us (883us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970220.639641:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970220.640234:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543808:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788970220.640281:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788970220.640307:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.640319:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970220.640341:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97787ef4d000 10000000:01000000:3.0:1788970220.640349:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788970220.640366:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97787ef4d000 10000000:01000000:3.0:1788970220.640369:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788970220.640373:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97787ef4d000 from 1 10000000:01000000:3.0:1788970220.640377:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788970220.640420:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.640430:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.640446:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970220.640466:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970220.640515:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.640547:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788970220.640636:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741543936 00000100:00100000:1.0:1788970220.640642:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741543936 00000100:00100000:1.0:1788970220.640693:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970220.640716:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+6:18907:x1875870741543936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970220.640728:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970220.640745:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93800/0x5d0de860b05b526d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5266 expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.640771:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93800/0x5d0de860b05b526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5266 expref: 7 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.640782:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93800/0x5d0de860b05b526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5266 expref: 7 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.640818:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93800, rc 0) 00000100:00100000:1.0:1788970220.640937:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+7:18907:x1875870741543936:12345-0@lo:101:mount.lustre.0 Request processed in 222us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.640944:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970220.642681:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741543936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970220.642727:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b526d expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.642742:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b526d expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970220.642767:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788970220.642786:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b526d expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.642815:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd400/0x5d0de860b05b5266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b526d expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970220.642861:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788970220.642868:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970220.642876:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97787ef4d000 10000000:01000000:3.0:1788970220.642879:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788970220.642894:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788970220.642897:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970220.642938:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.642946:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.642957:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970220.642995:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970220.643078:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.643518:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544064 00000100:00100000:1.0:1788970220.643527:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544064 00000100:00100000:1.0:1788970220.643584:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970220.643595:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+7:18907:x1875870741544064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970220.643611:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970220.643629:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f92800/0x5d0de860b05b527b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5274 expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.643656:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92800/0x5d0de860b05b527b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5274 expref: 8 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.643667:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f92800/0x5d0de860b05b527b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5274 expref: 8 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.643676:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92800, rc 0) 00000100:00100000:1.0:1788970220.644479:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+8:18907:x1875870741544064:12345-0@lo:101:mount.lustre.0 Request processed in 881us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.644491:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970220.649299:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970220.649370:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970220.649407:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b527b expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.649424:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b527b expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970220.649540:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970220.649617:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.649672:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.649767:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544192 00000100:00100000:2.0:1788970220.649777:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544192 00000100:00100000:2.0:1788970220.649881:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970220.649901:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+8:18907:x1875870741544192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970220.651486:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18907:x1875870741544192:12345-0@lo:501:mount.lustre.0 Request processed in 1582us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.651501:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970220.652220:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970220.652296:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970220.652380:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.652423:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788970220.652587:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544320 00000100:00100000:1.0:1788970220.652596:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544320 00000100:00100000:1.0:1788970220.652654:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970220.652664:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18907:x1875870741544320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970220.653288:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18907:x1875870741544320:12345-0@lo:503:mount.lustre.0 Request processed in 622us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.653298:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970220.653665:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970220.654769:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18943:1875870741544448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970220.654915:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.655191:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970220.655392:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544448 00000100:00100000:0.0:1788970220.655402:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544448 00000100:00100000:0.0:1788970220.655461:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970220.655472:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18943:x1875870741544448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970220.656297:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18943:x1875870741544448:12345-0@lo:502:llog_process_th.0 Request processed in 821us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970220.656322:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970220.656760:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18943:1875870741544448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788970220.656848:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970220.656864:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.656867:0:18943:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970220.656874:0:18943:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788970220.656878:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970220.657088:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff977850053380) 00000020:00000080:3.0:1788970220.657185:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788970220.657194:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788970220.657293:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788970220.657301:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b5289 00000020:00000080:3.0:1788970220.657569:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788970220.657574:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970220.657578:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.657579:0:18943:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788970220.657582:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970220.657586:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.657588:0:18943:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788970220.657591:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970220.657600:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff977850054d40) 00000020:00000080:3.0:1788970220.657611:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788970220.657614:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788970220.657617:0:18943:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788970220.657631:0:18943:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788970220.657638:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970220.658274:0:18943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787ef4d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788970220.658302:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff977850050000) 00000020:00000080:3.0:1788970220.658315:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788970220.658395:0:18943:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788970220.658403:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b529e 00000020:00000080:3.0:1788970220.658528:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788970220.658535:0:18943:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788970220.658544:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d0de860b05b52a5 00080000:01000000:3.0:1788970220.658551:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788970220.658556:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b52ac 00010000:00010000:3.0:1788970220.821971:0:18943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788970220.822387:0:18943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1788970220.822563:0:18943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788970220.831637:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9778652fb380) 00000020:00000080:3.0:1788970220.831670:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788970220.831771:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788970220.831779:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b52ba 00000020:00000080:3.0:1788970220.838159:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788970220.849823:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d0de860b05b52c1 00000020:00000080:3.0:1788970220.853344:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788970220.853361:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970220.853369:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.853372:0:18943:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788970220.853376:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788970220.853378:0:18943:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788970220.853380:0:18943:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970220.853381:0:18943:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788970220.853383:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788970220.853385:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.853386:0:18943:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788970220.853388:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970220.853393:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.853405:0:18943:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788970220.853411:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788970220.853456:0:18943:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788970220.853471:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970220.853475:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.853476:0:18943:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788970220.853478:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970220.853482:0:18943:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788970220.853484:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970220.853486:0:18943:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788970220.853488:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788970220.853494:0:18943:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:3.0:1788970220.853518:0:18943:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788970220.853521:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970220.853536:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9778652fcd40) 00000020:00000080:3.0:1788970220.853552:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788970220.853559:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788970220.853612:0:18943:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788970220.853618:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788970220.853625:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b52cf 00010000:00080000:0.0:1788970220.854386:0:18943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9778506c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970220.854736:0:18943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788970220.855358:0:18943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970220.855403:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788970220.857103:0:18943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970220.857186:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788970220.857469:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788970220.861685:0:18947:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788970220.861691:0:18947:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788970220.862779:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970220.863005:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788970220.863043:0:18943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788970220.863064:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b52d6 00000100:00080000:0.0:1788970220.863073:0:18943:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970220.863084:0:18943:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970220.863140:0:18943:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce7480 x1875870741544576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970220.863217:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741544576:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788970220.863269:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741544576 offset 0 length 520: 4 00000100:00080000:0.0:1788970220.863338:0:18943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788970220.863426:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970220.863431:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.863433:0:18943:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788970220.863436:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970220.863438:0:18943:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788970220.863439:0:18943:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970220.863441:0:18943:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970220.863442:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970220.863445:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.863446:0:18943:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970220.863448:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970220.863453:0:18943:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788970220.863461:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.863463:0:18943:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788970220.863466:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970220.863470:0:18943:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.109@tcp to nid 0x20000c0a8ca6d (192.168.202.109@tcp) 00000020:01000000:0.0:1788970220.863488:0:18943:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788970220.863490:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970220.863502:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff977741980000) 00000020:00000080:0.0:1788970220.863513:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788970220.863517:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970220.863570:0:18943:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788970220.863575:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788970220.863583:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d0de860b05b52e4 00010000:00080000:0.0:1788970220.863609:0:18943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff977878834000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970220.864148:0:18943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788970220.864393:0:18943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970220.864601:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788970220.865581:0:18943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970220.865901:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788970220.865974:0:18943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788970220.866549:0:18949:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788970220.866554:0:18949:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788970220.867398:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970220.867412:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788970220.867445:0:18943:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788970220.867465:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b52eb 00000100:00080000:0.0:1788970220.867474:0:18943:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970220.867485:0:18943:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff977878834000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970220.867520:0:18943:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce4b40 x1875870741544704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970220.867536:0:18943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788970220.867662:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970220.867667:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.867668:0:18943:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788970220.867671:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970220.867675:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.867676:0:18943:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788970220.867679:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970220.867680:0:18943:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970220.867683:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970220.867685:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.867687:0:18943:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970220.867689:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970220.867691:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970220.867693:0:18943:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970220.867696:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788970220.867727:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18943:1875870741544832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970220.867834:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970220.867876:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.868224:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544832 00000100:00100000:2.0:1788970220.868232:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544832 00000100:00100000:2.0:1788970220.868267:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970220.868275:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18943:x1875870741544832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970220.868522:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18943:x1875870741544832:12345-0@lo:502:llog_process_th.0 Request processed in 247us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.868534:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970220.868588:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18943:1875870741544832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970220.868613:0:18943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970220.868618:0:18943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970220.868620:0:18943:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788970220.868625:0:18943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788970220.868917:0:18907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788970220.868939:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:1.0:1788970220.869156:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741544704:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788970220.869194:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741544704 offset 0 length 520: 4 00010000:00010000:2.0:1788970220.869754:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b527b expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.869767:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd600/0x5d0de860b05b5274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b527b expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970220.870082:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787ef4d000 from 1 10000000:01000000:1.0:1788970220.870086:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970220.870122:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.870130:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.870139:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.870157:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970220.870261:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.870319:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.870367:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741544960 00000100:00100000:2.0:1788970220.870374:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741544960 00000100:00100000:2.0:1788970220.870446:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970220.870457:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+9:18907:x1875870741544960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970220.870468:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970220.870481:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b52f2 expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.870504:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 10 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.870514:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 10 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.870537:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030600, rc 0) 00000100:00100000:2.0:1788970220.870621:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+10:18907:x1875870741544960:12345-0@lo:101:mount.lustre.0 Request processed in 165us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.870628:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970220.870760:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741544960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970220.870774:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.870782:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.871575:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788970220.871624:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.871766:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970220.872027:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545088 00000100:00100000:3.0:1788970220.872034:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545088 00000100:00100000:3.0:1788970220.872075:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970220.872085:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+10:18907:x1875870741545088:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788970220.872101:0:18919:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788970220.872107:0:18919:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788970220.872362:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+10:18907:x1875870741545088:12345-0@lo:256:mount.lustre.0 Request processed in 279us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.872381:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970220.872520:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788970220.873762:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970220.873826:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.873838:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970220.873845:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787ef4d000 from 1 10000000:01000000:1.0:1788970220.873847:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970220.873880:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.873887:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.874019:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.874041:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970220.874095:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.874174:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970220.874344:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545216 00000100:00100000:3.0:1788970220.874352:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545216 00000100:00100000:3.0:1788970220.874404:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970220.874412:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+10:18907:x1875870741545216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970220.874424:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970220.874442:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5300 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.874465:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 11 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.874475:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 11 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970220.874485:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd800, rc 0) 00000100:00100000:3.0:1788970220.874531:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545216:12345-0@lo:101:mount.lustre.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.874537:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970220.874721:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970220.874735:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.874742:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.874842:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970220.874869:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.874916:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.875113:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545344 00000100:00100000:2.0:1788970220.875118:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545344 00000100:00100000:2.0:1788970220.875145:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970220.875152:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970220.875552:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545344:12345-0@lo:501:mount.lustre.0 Request processed in 400us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.875561:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970220.875750:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970220.875785:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970220.875859:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.875940:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970220.876438:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545472 00000100:00100000:0.0:1788970220.876444:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545472 00000100:00100000:0.0:1788970220.876520:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970220.876529:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970220.876859:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545472:12345-0@lo:503:mount.lustre.0 Request processed in 330us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970220.876867:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970220.877264:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970220.877880:0:18951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18951:1875870741545600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970220.877945:0:18951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.878217:0:18951:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.878350:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545600 00000100:00100000:2.0:1788970220.878357:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545600 00000100:00100000:2.0:1788970220.878387:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970220.878395:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18951:x1875870741545600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970220.878636:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18951:x1875870741545600:12345-0@lo:502:llog_process_th.0 Request processed in 241us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.878643:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970220.878822:0:18951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18951:1875870741545600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970220.878847:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970220.878856:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.878859:0:18951:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788970220.878866:0:18951:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787ef4d000 00000020:00000080:1.0:1788970220.878869:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970220.878876:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970220.878879:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.878880:0:18951:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788970220.878882:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970220.878884:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.878885:0:18951:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788970220.878888:0:18951:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787ef4d000 00000020:00000080:1.0:1788970220.879007:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970220.879067:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970220.879071:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.879073:0:18951:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788970220.879076:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970220.879079:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.879080:0:18951:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970220.879090:0:18951:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97787ef4d000 00000020:00000080:1.0:1788970220.879092:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788970220.879131:0:18951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18951:1875870741545728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970220.879168:0:18951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.879188:0:18951:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850c76e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970220.880819:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545728 00000100:00100000:1.0:1788970220.880832:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545728 00000100:00100000:1.0:1788970220.880877:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970220.880885:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18951:x1875870741545728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970220.881284:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18951:x1875870741545728:12345-0@lo:502:llog_process_th.0 Request processed in 399us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.881292:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970220.881364:0:18951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18951:1875870741545728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970220.881395:0:18951:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970220.881403:0:18951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970220.881405:0:18951:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788970220.881410:0:18951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788970220.881858:0:18907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788970220.881876:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970220.881972:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.881985:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970220.882036:0:18907:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970220.882039:0:18907:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97787ef4d000 10000000:01000000:0.0:1788970220.882042:0:18907:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97787ef4d000 10000000:01000000:0.0:1788970220.882046:0:18907:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970220.882052:0:18907:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97787ef4d000 from 1 10000000:01000000:0.0:1788970220.882055:0:18907:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970220.882088:0:18907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.882096:0:18907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.882106:0:18907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970220.882125:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970220.882165:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.882773:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545856 00000100:00100000:1.0:1788970220.882780:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545856 00000100:00100000:1.0:1788970220.882832:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970220.882841:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741545856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970220.882853:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970220.882867:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f92c00/0x5d0de860b05b5315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b530e expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.882889:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92c00/0x5d0de860b05b5315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b530e expref: 12 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970220.882995:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788970220.883270:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f92c00/0x5d0de860b05b5315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b530e expref: 12 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.883279:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92c00, rc 0) 00000100:00100000:1.0:1788970220.884779:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741545856:12345-0@lo:101:mount.lustre.0 Request processed in 1933us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.884802:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970220.892148:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970220.892176:0:18907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5315 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.892190:0:18907:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5315 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970220.892353:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970220.892412:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970220.892468:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977853619c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970220.892551:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741545984 00000100:00100000:3.0:1788970220.892558:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741545984 00000100:00100000:3.0:1788970220.892610:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788970220.892621:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741545984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970220.895075:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741545984:12345-0@lo:501:mount.lustre.0 Request processed in 2447us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.895088:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970220.902852:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741545984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970220.903141:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741546112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970220.903227:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.903274:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.903367:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546112 00000100:00100000:2.0:1788970220.903374:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546112 00000100:00100000:2.0:1788970220.903426:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970220.903434:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741546112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970220.903643:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741546112:12345-0@lo:503:mount.lustre.0 Request processed in 209us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970220.903664:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970220.904375:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741546112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970220.905063:0:18956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18956:1875870741546240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970220.905115:0:18956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970220.905185:0:18956:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500add80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970220.914755:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546240 00000100:00100000:2.0:1788970220.914768:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546240 00000100:00100000:1.0:1788970220.916471:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788970220.916488:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18956:x1875870741546240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970220.916836:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18956:x1875870741546240:12345-0@lo:502:llog_process_th.0 Request processed in 353us (11718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.916843:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970220.917082:0:18956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18956:1875870741546240:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788970220.917154:0:18956:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788970220.917169:0:18956:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff977879a8b380) 00000020:00000080:2.0:1788970220.917189:0:18956:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788970220.917302:0:18956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787ef4d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970220.917305:0:18956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787ef4d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788970220.917308:0:18956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787ef4d000 4 00010000:00080000:2.0:1788970220.917351:0:18956:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787f51f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1788970220.923467:0:18956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788970220.927460:0:18956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788970220.927515:0:18956:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970220.927529:0:18956:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d0de860b05b5323 00000100:00080000:2.0:1788970220.927538:0:18956:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970220.927550:0:18956:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97787f51f800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970220.927590:0:18956:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e0f00 x1875870741546368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970220.927614:0:18956:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788970220.929488:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741546368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970220.929555:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970220.930156:0:18956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18956:1875870741546496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970220.930202:0:18956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970220.930224:0:18956:0:(client.c:2716:ptlrpc_set_wait()) set ffff977849162f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970220.930378:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546368 00000100:00100000:0.0:1788970220.930386:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546368 00000100:00100000:0.0:1788970220.930428:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970220.930435:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741546368:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970220.930493:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875870741546368:12345-0@lo:38:llog_process_th.0 Request processed in 56us (935us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788970220.930499:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970220.931123:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546496 00000100:00100000:3.0:1788970220.931129:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546496 00000100:00100000:3.0:1788970220.931162:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970220.931170:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18956:x1875870741546496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970220.931420:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18956:x1875870741546496:12345-0@lo:502:llog_process_th.0 Request processed in 250us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970220.931428:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970220.931481:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970220.931489:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f51f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970220.931493:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788970220.931497:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741546368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970220.931536:0:18956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18956:1875870741546496:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788970220.931559:0:18956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788970220.932628:0:18907:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788970220.932678:0:18907:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970220.932696:0:18907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5315 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970220.932715:0:18907:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f484800/0x5d0de860b05b530e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5315 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970220.932814:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970220.932817:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970220.932818:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970220.932819:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970220.932821:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970220.932831:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970220.932832:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970220.932833:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970220.932835:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970220.932837:0:18907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970220.932841:0:18907:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788970220.932844:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970220.932845:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970220.932847:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970220.932848:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970220.932849:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970220.932850:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970220.932851:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970220.932852:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970220.932853:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970220.932854:0:18907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970220.932876:0:18907:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788970220.932894:0:18907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741546624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970220.932957:0:18907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970220.932993:0:18907:0:(client.c:2716:ptlrpc_set_wait()) set ffff977849162f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970220.933460:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546624 00000100:00100000:3.0:1788970220.933467:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546624 00000100:00100000:3.0:1788970220.933513:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970220.933522:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18907:x1875870741546624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788970220.933556:0:18919:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788970220.933570:0:18919:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788970220.993090:0:18919:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788970220.993109:0:18919:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788970220.993210:0:18941:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970220.993216:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970220.993252:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.993271:0:18941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 12 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.993279:0:18941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.993319:0:18941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 12 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970220.993345:0:18941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 12 pid: 18917 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970220.993360:0:18941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741546752:0@lo:104: 00000100:00100000:0.0:1788970220.993425:0:18941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970220.993483:0:18941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778536199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970220.993685:0:18908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546752 00000100:00100000:1.0:1788970220.993693:0:18908:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546752 00000100:00100000:1.0:1788970220.993742:0:18908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970220.993752:0:18908:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741546752:12345-0@lo:104: 00010000:00010000:1.0:1788970220.993765:0:18908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.993853:0:18908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970220.993859:0:18908:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741546752:12345-0@lo:104: Request processed in 109us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.993867:0:18908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788970220.993890:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970220.993909:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.993916:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788970220.993919:0:18914:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.993938:0:18914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970220.993946:0:18914:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970220.993952:0:18914:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970220.993983:0:18914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.993990:0:18914:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970220.994012:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994019:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f92400/0x5d0de860b05b52f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b52f9 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994037:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970220.994038:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970220.994040:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970220.994070:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741546880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970220.994099:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970220.994177:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741546880 00000100:00100000:1.0:1788970220.994186:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741546880 00010000:00010000:1.0:1788970220.994204:0:18910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 13 pid: 18917 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.994226:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970220.994232:0:18910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+13:3284:x1875870741546880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970220.994253:0:18910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970220.994258:0:18910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 13 pid: 18917 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994268:0:18910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 13 pid: 18917 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994283:0:18910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994291:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970220.994304:0:18910:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001089007s 00010000:00010000:1.0:1788970220.994308:0:18910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994314:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994330:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994337:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994352:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970220.994356:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994364:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994373:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994382:0:18910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970220.994415:0:18910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+13:3284:x1875870741546880:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970220.994421:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970220.994458:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741546880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970220.994497:0:18941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840030600/0x5d0de860b05b52f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b52f2 expref: 12 pid: 18917 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970220.994508:0:18941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741546752:0@lo:104: 00010000:00010000:1.0:1788970220.994519:0:18941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994528:0:18941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994534:0:18941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970220.994550:0:18941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f485600/0x5d0de860b05b532a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970221.007653:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18907:x1875870741546624:12345-0@lo:253:mount.lustre.0 Request processed in 74120us (74683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970221.007669:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970221.007812:0:18907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18907:1875870741546624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970221.007839:0:18907:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788970221.007843:0:18907:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970221.007845:0:18907:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970221.007846:0:18907:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970221.007860:0:18907:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970221.007861:0:18907:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970221.007863:0:18907:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970221.007864:0:18907:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970221.007865:0:18907:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970221.007867:0:18907:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970221.007868:0:18907:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970221.007891:0:18907:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788970221.014451:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788970221.014715:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788970221.015193:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788970221.015445:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788970221.016021:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788970221.016187:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970221.017596:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970221.017764:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970221.018340:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970221.018682:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970221.019117:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970221.019441:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788970221.078767:0:18907:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:0.0:1788970221.080043:0:18907:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788970221.080461:0:18964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788970221.080556:0:18964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970221.082544:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788970221.082643:0:18964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788970221.082647:0:18964:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788970221.085381:0:18907:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788970221.088155:0:18907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788970221.088679:0:18963:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:3.0:1788970221.088686:0:18963:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000004:00000080:1.0:1788970221.089381:0:18907:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788970221.089398:0:18907:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788970221.089729:0:18907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970221.091218:0:18907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788970221.093156:0:18907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788970221.093309:0:18907:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788970221.094163:0:18907:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788970221.095417:0:18907:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788970221.100997:0:18907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788970221.180171:0:18907:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788970221.180236:0:18907:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc26c1c53988 00100000:10000000:1.0:1788970221.180244:0:18907:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788970221.182072:0:18907:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788970221.182092:0:18907:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788970221.182111:0:18907:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788970221.182128:0:18907:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788970221.382782:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788970221.957097:0:18922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970221.957106:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787ef4d000 from 9 10000000:01000000:1.0:1788970221.957112:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970221.957161:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.957173:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.957185:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970221.957227:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970221.957346:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970221.957435:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778492343c0 going to sleep for 11 seconds 00000040:00080000:0.0:1788970221.957666:0:18957:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788970221.957671:0:18957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970221.958156:0:18957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788970221.958163:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788970221.958419:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547008 00000100:00100000:3.0:1788970221.958428:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547008 00000100:00100000:3.0:1788970221.958481:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970221.958491:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18922:x1875870741547008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970221.958507:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970221.958525:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5331 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.958548:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.958559:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970221.958568:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd000, rc 0) 00000100:00100000:3.0:1788970221.958721:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.958728:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788970221.959087:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970221.959106:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.959115:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970221.959175:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970221.959411:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970221.959490:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778492343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970221.959535:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547136 00000100:00100000:3.0:1788970221.959540:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547136 00000100:00100000:3.0:1788970221.959616:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970221.959624:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970221.959641:0:18919:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970221.959659:0:18919:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970221.959663:0:18919:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788970221.959752:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970221.959759:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970221.959832:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788970221.959870:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970221.959878:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970221.959887:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970222.409283:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788970222.981401:0:18957:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788970222.981411:0:18957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970222.983217:0:18957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788970222.983283:0:18957:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788970222.983323:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788970223.433239:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970224.453003:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970225.477957:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970225.612609:0:19207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788970226.116996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970226.117004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970226.117007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970226.117011:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970226.117014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788970226.117017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788970226.117021:0:8:0:(import.c:65:import_set_state_nolock()) ffff97787f51f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970226.117040:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97787f51f800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970226.117073:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741547264:0@lo:400:kworker.0 00000100:00100000:2.0:1788970226.117144:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970226.117631:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e3c00 x1875870741547392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970226.117659:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741547392:0@lo:38:kworker.0 00000100:00100000:2.0:1788970226.117694:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970226.118032:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547264 00000100:00100000:3.0:1788970226.118041:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547264 00000100:00100000:0.0:1788970226.118071:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547392 00000100:00100000:0.0:1788970226.118077:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547392 00000100:00100000:0.0:1788970226.118107:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970226.118114:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741547392:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788970226.118147:0:18927:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000100:00100000:3.0:1788970226.118166:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970226.118177:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:3285:x1875870741547264:12345-0@lo:400:kworker.0 00000020:00000080:0.0:1788970226.118187:0:18927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d0de860b05b533f 00000004:00100000:0.0:1788970226.118204:0:18927:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788970226.118237:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:3285:x1875870741547264:12345-0@lo:400:kworker.0 Request processed in 62us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970226.118246:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788970226.118358:0:18927:0:(import.c:65:import_set_state_nolock()) ffff977843434000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970226.118412:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875870741547392:12345-0@lo:38:kworker.0 Request processed in 298us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970226.118419:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788970226.119029:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9778812e3c00 x1875870741547392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970226.119046:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788970226.119055:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00100000:2.0:1788970226.119465:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741547264:0@lo:400:kworker.0 00000100:00080000:3.0:1788970226.124000:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788970226.124006:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787f51f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970226.124020:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875870741547392:0@lo:38:kworker.0 00010000:00010000:1.0:1788970226.501498:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970227.525419:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970228.549362:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788970228.804877:0:19357:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1ead9600 20000000:00000080:1.0:1788970228.804906:0:19357:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff977844925c00 uarg=0000000000000000 20000000:01000000:1.0:1788970228.804966:0:19357:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788970228.804975:0:19357:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788970228.804981:0:19357:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788970228.808216:0:19358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788970228.808635:0:19357:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788970228.818150:0:19357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788970228.820468:0:19357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.820507:0:19357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 11 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.820517:0:19357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.820592:0:19357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 11 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.820618:0:19357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 11 pid: 18919 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970228.820636:0:19357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19357:1875870741547520:0@lo:104: 00000100:00100000:1.0:1788970228.820725:0:19357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970228.820850:0:19357:0:(client.c:2716:ptlrpc_set_wait()) set ffff977850bb0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970228.820994:0:18909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547520 00000100:00100000:0.0:1788970228.821007:0:18909:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547520 00000100:00100000:0.0:1788970228.821076:0:18909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970228.821091:0:18909:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:19357:x1875870741547520:12345-0@lo:104: 00010000:00010000:0.0:1788970228.821106:0:18909:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970228.821169:0:18909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970228.821176:0:18909:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:19357:x1875870741547520:12345-0@lo:104: Request processed in 87us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970228.821185:0:18909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788970228.821212:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970228.821221:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970228.821282:0:19357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19357:1875870741547520:0@lo:104: 00010000:00010000:2.0:1788970228.821337:0:19357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.821950:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:3.0:1788970228.821965:0:18913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.821976:0:18913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970228.821985:0:18913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970228.821991:0:18913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788970228.822044:0:18913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822050:0:18913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788970228.822089:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822097:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f93e00/0x5d0de860b05b5300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5307 expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822120:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970228.822123:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970228.822125:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970228.822173:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741547648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970228.822238:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970228.822535:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547648 00000100:00100000:3.0:1788970228.822543:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547648 00010000:00010000:3.0:1788970228.822570:0:18910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 12 pid: 18919 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970228.822601:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970228.822620:0:18911:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788970228.822624:0:18910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:3286:x1875870741547648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970228.822631:0:18911:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788970228.822638:0:18910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970228.822645:0:18910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 12 pid: 18919 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822659:0:18910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 12 pid: 18919 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822676:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b5300 expref: 12 pid: 18919 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822694:0:18910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822704:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822721:0:18910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822729:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822736:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822743:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822749:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970228.822754:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822768:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822811:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970228.822823:0:18910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970228.822842:0:19357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.822850:0:19357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970228.822856:0:19357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92e00/0x5d0de860b05b5346 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970228.822878:0:18910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:3286:x1875870741547648:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970228.822885:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970228.823614:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741547648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970229.576129:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970230.086736:0:18922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970230.086752:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787ef4d000 from 10 10000000:01000000:0.0:1788970230.086761:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970230.086988:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.087017:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.087099:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970230.087149:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970230.087282:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970230.087397:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970230.087443:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547776 00000100:00100000:0.0:1788970230.087469:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547776 00000100:00100000:0.0:1788970230.087564:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970230.087576:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+11:18922:x1875870741547776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970230.087607:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970230.087627:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b534d expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.087662:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b534d expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.087677:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b534d expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.087689:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485200, rc 0) 00000100:00100000:0.0:1788970230.087735:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970230.087742:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970230.091087:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970230.091137:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970230.091187:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970230.091326:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970230.091463:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970230.091561:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f1cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970230.091860:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741547904 00000100:00100000:3.0:1788970230.091869:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741547904 00000100:00100000:3.0:1788970230.091924:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970230.091935:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970230.092347:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741547904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970230.092356:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970230.092471:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741547904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970230.092552:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741548032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970230.092640:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970230.092662:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977843022240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970230.092711:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548032 00000100:00100000:3.0:1788970230.092716:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548032 00000100:00100000:3.0:1788970230.092779:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970230.092850:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741548032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970230.093166:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:18922:x1875870741548032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970230.093183:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970230.093289:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741548032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970230.094331:0:19395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788970230.094407:0:18922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788970230.094443:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970230.094456:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970230.094471:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970230.213616:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970220/real 1788970220] req@ffff97787dce4b40 x1875870741544704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970230.213667:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787dce4b40 x1875870741544704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970230.213679:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970220/real 1788970220] req@ffff97787dce7480 x1875870741544576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970230.213692:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787dce7480 x1875870741544576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970230.213713:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970230.213747:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970230.213751:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741544704:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788970230.213758:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970230.213764:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788970230.213767:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741544576:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788970230.213948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970230.213955:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788970230.213959:0:8:0:(import.c:65:import_set_state_nolock()) ffff9778506c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970230.213965:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1788970230.213971:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970230.213986:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788970230.214032:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff66580 x1875870741548160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970230.214053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970230.214056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788970230.214057:0:8:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970230.214060:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1788970230.214063:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970230.214068:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff977878834000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788970230.214080:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff64b40 x1875870741548288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970230.214137:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970230.214150:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741548416:0@lo:400:kworker.0 00000100:00100000:1.0:1788970230.214248:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970230.214354:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548416 00000100:00100000:1.0:1788970230.214364:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548416 00000100:00100000:1.0:1788970230.214416:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970230.214428:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970230.214505:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741548416:12345-0@lo:400:kworker.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970230.214512:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788970230.214554:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97787ff64000 x1875870741548416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970230.214567:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741548416:0@lo:400:kworker.0 00000100:00100000:0.0:1788970230.216658:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741548160:0@lo:8:kworker.0 00000400:00000100:0.0:1788970230.216744:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741548160 offset 0 length 520: 4 00000100:00100000:0.0:1788970230.216837:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741548288:0@lo:8:kworker.0 00000400:00000100:0.0:1788970230.216862:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875870741548288 offset 0 length 520: 4 00010000:00010000:3.0:1788970230.596961:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970231.627849:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970232.200100:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788970232.644987:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970233.669260:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970234.695153:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970235.242407:0:19607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788970235.242412:0:19607:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788970235.242530:0:19607:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97787f51c000 00000020:01000004:2.0:1788970235.242548:0:19607:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788970235.242562:0:19607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788970235.242576:0:19607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff977879a8cd40) 00000020:00000080:2.0:1788970235.242593:0:19607:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788970235.284258:0:19607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788970235.284533:0:19607:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788970235.287114:0:19607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788970235.288186:0:19607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788970235.288463:0:19607:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788970235.290472:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 473: rc = 0 00100000:10000000:0.0:1788970235.290636:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 473: rc = 0 00100000:10000000:0.0:1788970235.292090:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 473: rc = 0 00100000:10000000:0.0:1788970235.292627:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1788970235.294208:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1788970235.304582:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788970235.305210:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788970235.305454:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1788970235.305687:0:19607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00000020:00000080:1.0:1788970235.307634:0:19607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788970235.307648:0:19607:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970235.307660:0:19607:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b5362 00000020:01000004:1.0:1788970235.307668:0:19607:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788970235.307687:0:19607:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788970235.307703:0:19607:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788970235.307709:0:19607:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788970235.307715:0:19607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788970235.307727:0:19607:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9778652ab380) 00000020:00000080:1.0:1788970235.309612:0:19607:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788970235.315325:0:19607:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970235.315534:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970235.315541:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788970235.317156:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788970235.317167:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788970235.321999:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788970235.322014:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788970235.324114:0:19607:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788970235.324331:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788970235.324337:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788970235.329120:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788970235.329136:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00080000:0.0:1788970235.336079:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970235.336086:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970235.336090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970235.336093:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788970235.336135:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741548672:0@lo:400:kworker.0 00000100:00100000:0.0:1788970235.336224:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970235.336308:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548672 00000100:00100000:0.0:1788970235.336316:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548672 00000100:00100000:0.0:1788970235.336361:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970235.336370:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741548672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970235.336421:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741548672:12345-0@lo:400:kworker.0 Request processed in 51us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.336428:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788970235.336469:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97787dce4f00 x1875870741548672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970235.336484:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788970235.336544:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741548544:0@lo:400:kworker.0 00000100:00100000:1.0:1788970235.336592:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970235.336668:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548544 00000100:00100000:0.0:1788970235.336673:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548544 00000100:00100000:0.0:1788970235.336719:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788970235.336727:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:3284:x1875870741548544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970235.336765:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:3284:x1875870741548544:12345-0@lo:400:kworker.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.336771:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788970235.336831:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741548544:0@lo:400:kworker.0 00000100:00100000:2.0:1788970235.369778:0:19607:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970235.373732:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970235.373739:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788970235.375373:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788970235.375385:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788970235.383680:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788970235.383693:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788970235.386606:0:19607:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970235.388367:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788970235.388375:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788970235.407468:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788970235.407487:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788970235.475571:0:19607:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970235.479019:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788970235.479035:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788970235.481417:0:19607:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788970235.481431:0:19607:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788970235.483370:0:19607:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788970235.483395:0:19607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788970235.483402:0:19607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970235.507076:0:19607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970235.507112:0:19607:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.109@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788970235.507117:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970235.507119:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970235.507121:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970235.507122:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970235.507124:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970235.507125:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970235.507126:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970235.507128:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970235.507129:0:19607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970235.507133:0:19607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788970235.507135:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970235.507137:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788970235.507138:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970235.507144:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970235.507145:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970235.507146:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970235.507147:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970235.507148:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970235.507149:0:19607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970235.507173:0:19607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788970235.509604:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741548800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970235.509710:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.509766:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.509928:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548800 00000100:00100000:0.0:1788970235.509938:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548800 00000100:00100000:0.0:1788970235.509997:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970235.510006:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:19607:x1875870741548800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970235.510072:0:18917:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788970235.510075:0:18917:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788970235.510079:0:18917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788970235.517023:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:19607:x1875870741548800:12345-0@lo:253:mount.lustre.0 Request processed in 7008us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.517038:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970235.517389:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741548800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970235.517407:0:19607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788970235.517411:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970235.517412:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788970235.517414:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970235.517415:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970235.517416:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970235.517417:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970235.517419:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970235.517420:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970235.517421:0:19607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970235.517442:0:19607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787f51c000 from lustre-OST0000 10000000:01000000:0.0:1788970235.517495:0:19607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788970235.517498:0:19607:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788970235.517505:0:19607:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff977741984d40 local copy 00010000:00010000:0.0:1788970235.517515:0:19607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970235.517731:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741548928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970235.517772:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970235.517950:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970235.518294:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741548928 00000100:00100000:1.0:1788970235.518303:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741548928 00000100:00100000:1.0:1788970235.518387:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970235.518397:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:19607:x1875870741548928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970235.518580:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:19607:x1875870741548928:12345-0@lo:501:mount.lustre.0 Request processed in 184us (806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970235.518588:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970235.518668:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741548928:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788970235.518683:0:19607:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788970235.518873:0:19607:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788970235.518880:0:19607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.518916:0:19607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970235.518938:0:19607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97787f51c000 10000000:01000000:0.0:1788970235.518942:0:19607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788970235.518948:0:19607:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff977741984d40 10000000:01000000:0.0:1788970235.518950:0:19607:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788970235.518953:0:19607:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff977741984d40 from 1 10000000:01000000:0.0:1788970235.518956:0:19607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788970235.518982:0:19607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.518990:0:19607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.519000:0:19607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970235.519015:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970235.519044:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970235.519578:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.522539:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549056 00000100:00100000:3.0:1788970235.522553:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549056 00000100:00100000:3.0:1788970235.522608:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970235.522619:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+12:19607:x1875870741549056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970235.522636:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970235.522656:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5377 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5370 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.522696:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5370 expref: 13 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.522709:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9778821dd800/0x5d0de860b05b5377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5370 expref: 13 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.522719:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9778821dd800, rc 0) 00000100:00100000:3.0:1788970235.522803:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+13:19607:x1875870741549056:12345-0@lo:101:mount.lustre.0 Request processed in 170us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.522810:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970235.523270:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970235.523287:0:19607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5377 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.523297:0:19607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5377 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970235.523341:0:19607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788970235.523362:0:19607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5377 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.523370:0:19607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f484400/0x5d0de860b05b5370 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5377 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970235.523379:0:19607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788970235.523384:0:19607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970235.523391:0:19607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788970235.523394:0:19607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788970235.523419:0:19607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.523424:0:19607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.523430:0:19607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970235.523442:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970235.523471:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970235.523504:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970235.523515:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549184 00000100:00100000:1.0:1788970235.523520:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549184 00000100:00100000:1.0:1788970235.523557:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788970235.523565:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+13:19607:x1875870741549184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970235.523573:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970235.523582:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93c00/0x5d0de860b05b5385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b537e expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.523595:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93c00/0x5d0de860b05b5385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b537e expref: 14 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.523603:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93c00/0x5d0de860b05b5385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b537e expref: 14 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.523610:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93c00, rc 0) 00000100:00100000:1.0:1788970235.523661:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549184:12345-0@lo:101:mount.lustre.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970235.523667:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970235.529657:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970235.529690:0:19607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5385 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.529704:0:19607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5385 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970235.531686:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788970235.536343:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970235.536624:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788970235.536667:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788970235.536700:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788970235.536747:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788970235.536830:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788970235.536871:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788970235.536920:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788970235.536956:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788970235.536988:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788970235.537034:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788970235.537071:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788970235.537115:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788970235.539054:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788970235.539079:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788970235.539199:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970235.539263:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970235.539371:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778500ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.543096:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549312 00000100:00100000:0.0:1788970235.543111:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549312 00000100:00100000:0.0:1788970235.543169:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970235.543178:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970235.545078:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549312:12345-0@lo:501:mount.lustre.0 Request processed in 1893us (5807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.545106:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970235.545859:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970235.549081:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970235.549161:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.549220:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.549231:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549440 00000100:00100000:0.0:1788970235.549240:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549440 00000100:00100000:0.0:1788970235.549302:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970235.549312:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970235.549685:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549440:12345-0@lo:503:mount.lustre.0 Request processed in 373us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.549704:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970235.549886:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970235.550498:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970235.550565:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.550610:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.550651:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.553510:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549568 00000100:00100000:0.0:1788970235.553525:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549568 00000100:00100000:0.0:1788970235.553636:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970235.553647:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970235.555687:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549568:12345-0@lo:502:mount.lustre.0 Request processed in 2036us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.555700:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970235.555843:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970235.556084:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788970235.556134:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788970235.556161:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788970235.556214:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788970235.556246:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788970235.556272:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788970235.556309:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788970235.556337:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788970235.556362:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788970235.556399:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788970235.556427:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788970235.556485:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788970235.556520:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.556564:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.557059:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970235.557120:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549696 00000100:00100000:1.0:1788970235.557127:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549696 00000100:00100000:1.0:1788970235.557162:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970235.557170:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970235.557362:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549696:12345-0@lo:502:mount.lustre.0 Request processed in 191us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970235.557368:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970235.557463:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970235.557538:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788970235.557549:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788970235.558466:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788970235.558476:0:19621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788970235.558481:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970235.558489:0:19621:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788970235.558493:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970235.558507:0:19621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9778652f8000) 00000020:00000080:3.0:1788970235.558527:0:19621:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788970235.558532:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970235.558599:0:19621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787f51c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788970235.558605:0:19621:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970235.558612:0:19621:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d0de860b05b5393 00010000:00010000:3.0:1788970235.569760:0:19621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788970235.570272:0:19621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:3.0:1788970235.571760:0:19621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788970235.573773:0:19621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788970235.573784:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970235.573815:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.573817:0:19621:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788970235.573823:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788970235.573826:0:19621:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788970235.573828:0:19621:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970235.573829:0:19621:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970235.573831:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788970235.573834:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.573835:0:19621:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788970235.573838:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970235.573841:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.573842:0:19621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788970235.573844:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788970235.573846:0:19621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788970235.573848:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970235.573851:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.573852:0:19621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788970235.573854:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970235.573856:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.573858:0:19621:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788970235.573869:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788970235.575378:0:19621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970235.575387:0:19621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970235.575389:0:19621:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788970235.575395:0:19621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788970235.576084:0:19607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788970235.576122:0:19607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788970235.576140:0:19607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5385 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.576152:0:19607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f484e00/0x5d0de860b05b537e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5385 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970235.576161:0:19607:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787f51c000 from 1 10000000:01000000:3.0:1788970235.576164:0:19607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970235.576212:0:19607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.576220:0:19607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.576230:0:19607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970235.576252:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970235.576327:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.576370:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970235.576484:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549824 00000100:00100000:2.0:1788970235.576492:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549824 00000100:00100000:2.0:1788970235.576578:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970235.576588:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+14:19607:x1875870741549824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970235.576601:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970235.576614:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b539a expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.576637:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b539a expref: 15 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.576658:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b539a expref: 15 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.576666:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788970235.576715:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741549824:12345-0@lo:101:mount.lustre.0 Request processed in 128us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.576722:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970235.576819:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970235.576833:0:19607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.576843:0:19607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970235.577414:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788970235.577699:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970235.577952:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788970235.577999:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788970235.578049:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788970235.578083:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788970235.578132:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788970235.578177:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788970235.578228:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788970235.578258:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788970235.578320:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788970235.578327:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788970235.578392:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970235.578441:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.580351:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.581665:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741549952 00000100:00100000:0.0:1788970235.581677:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741549952 00000100:00100000:0.0:1788970235.581750:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788970235.581761:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741549952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970235.582090:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741549952:12345-0@lo:501:mount.lustre.0 Request processed in 330us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.582098:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788970235.582367:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741549952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970235.582417:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970235.582465:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.582488:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778436d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.583004:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550080 00000100:00100000:3.0:1788970235.583011:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550080 00000100:00100000:3.0:1788970235.583037:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970235.583045:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970235.583223:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550080:12345-0@lo:503:mount.lustre.0 Request processed in 177us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.583230:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970235.583275:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970235.583758:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970235.583849:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.583905:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.583933:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550208 00000100:00100000:3.0:1788970235.583938:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550208 00000100:00100000:3.0:1788970235.583958:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970235.583965:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.584102:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550208:12345-0@lo:502:mount.lustre.0 Request processed in 137us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.584110:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970235.584150:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff977855d8e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.584164:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970235.584401:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788970235.584445:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788970235.584490:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788970235.584526:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788970235.584557:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788970235.584603:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788970235.584639:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788970235.584686:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788970235.584711:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.584747:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.584776:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550336 00000100:00100000:3.0:1788970235.584781:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550336 00000100:00100000:3.0:1788970235.584836:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970235.584843:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.584964:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550336:12345-0@lo:502:mount.lustre.0 Request processed in 121us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.584972:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970235.585022:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.585036:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970235.585116:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788970235.585126:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788970235.590197:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970235.590211:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590214:0:19625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970235.590221:0:19625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787f51c000 00000020:00000080:2.0:1788970235.590223:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970235.590231:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970235.590234:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590235:0:19625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788970235.590237:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970235.590240:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590241:0:19625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788970235.590243:0:19625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787f51c000 00000020:00000080:2.0:1788970235.590245:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970235.590305:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970235.590309:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590310:0:19625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788970235.590312:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970235.590314:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590316:0:19625:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970235.590319:0:19625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97787f51c000 00000020:00000080:2.0:1788970235.590321:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970235.590354:0:19625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970235.590358:0:19625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970235.590365:0:19625:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788970235.590369:0:19625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788970235.590531:0:19607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788970235.590559:0:19607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970235.590584:0:19607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.590597:0:19607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970235.590639:0:19607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970235.590642:0:19607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97787f51c000 10000000:01000000:3.0:1788970235.590645:0:19607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97787f51c000 10000000:01000000:3.0:1788970235.590649:0:19607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970235.590656:0:19607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97787f51c000 from 1 10000000:01000000:3.0:1788970235.590659:0:19607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970235.590703:0:19607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.590712:0:19607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.590723:0:19607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970235.590762:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970235.590850:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.590894:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970235.590964:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550464 00000100:00100000:0.0:1788970235.590972:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550464 00000100:00100000:0.0:1788970235.591023:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970235.591033:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741550464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970235.591055:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970235.591070:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f485000/0x5d0de860b05b53af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b53a8 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.591096:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485000/0x5d0de860b05b53af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b53a8 expref: 16 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.591107:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f485000/0x5d0de860b05b53af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b53a8 expref: 16 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970235.591115:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f485000, rc 0) 00000100:00100000:0.0:1788970235.591165:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550464:12345-0@lo:101:mount.lustre.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970235.591172:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970235.591218:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970235.591237:0:19607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53af expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.591246:0:19607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b53af expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970235.591872:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788970235.592238:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970235.592491:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788970235.592535:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788970235.592568:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788970235.592625:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788970235.592663:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788970235.592712:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788970235.592748:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788970235.592784:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788970235.592861:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788970235.592896:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788970235.592929:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788970235.592979:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788970235.593018:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788970235.593070:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788970235.593120:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788970235.593155:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788970235.593203:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788970235.593252:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788970235.593288:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788970235.593321:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788970235.593367:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788970235.593412:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788970235.593445:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788970235.593493:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788970235.593527:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788970235.593562:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788970235.593607:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788970235.593643:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788970235.593675:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788970235.593740:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788970235.593778:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788970235.593845:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788970235.593880:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788970235.593927:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788970235.593963:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788970235.594009:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788970235.594045:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788970235.594077:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788970235.594140:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788970235.594178:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788970235.611039:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788970235.611058:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788970235.611170:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970235.611273:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.611315:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970235.611555:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550592 00000100:00100000:2.0:1788970235.611563:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550592 00000100:00100000:2.0:1788970235.611615:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788970235.611624:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970235.611881:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550592:12345-0@lo:501:mount.lustre.0 Request processed in 257us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.611889:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970235.615589:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970235.615657:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970235.615751:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.615814:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778615fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970235.615942:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550720 00000100:00100000:2.0:1788970235.615950:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550720 00000100:00100000:2.0:1788970235.616008:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970235.616018:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970235.616233:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550720:12345-0@lo:503:mount.lustre.0 Request processed in 216us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.616241:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970235.619426:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970235.623419:0:19607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970235.623512:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.623597:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.623638:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550848 00000100:00100000:3.0:1788970235.623646:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550848 00000100:00100000:3.0:1788970235.623709:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788970235.623717:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.623929:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550848:12345-0@lo:502:mount.lustre.0 Request processed in 211us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.623937:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788970235.623988:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.624011:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970235.624228:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788970235.624270:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788970235.624298:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788970235.624336:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788970235.624367:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788970235.624409:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788970235.624440:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788970235.624468:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788970235.624507:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788970235.624538:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788970235.624565:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788970235.624623:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788970235.624657:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788970235.624687:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788970235.624727:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788970235.624761:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788970235.624813:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788970235.624879:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788970235.624919:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788970235.624952:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788970235.625000:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788970235.625038:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788970235.625071:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788970235.625131:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788970235.625169:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788970235.625219:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788970235.625270:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788970235.625324:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788970235.625360:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788970235.625412:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788970235.625452:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788970235.625485:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788970235.625518:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788970235.625568:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788970235.625604:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788970235.625649:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788970235.625683:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788970235.625715:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788970235.625760:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788970235.625823:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788970235.625868:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970235.625927:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970235.625974:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741550976 00000100:00100000:3.0:1788970235.625980:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741550976 00000100:00100000:3.0:1788970235.626022:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788970235.626030:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970235.628563:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff977844d32180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970235.632995:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741550976:12345-0@lo:502:mount.lustre.0 Request processed in 6956us (7058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.633011:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788970235.633160:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741550976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970235.633326:0:19607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788970235.633342:0:19607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788970235.639997:0:19630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788970235.640021:0:19630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff977880b33380) 00000020:00000080:0.0:1788970235.640042:0:19630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788970235.640124:0:19630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787f51c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788970235.640129:0:19630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787f51c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788970235.640131:0:19630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787f51c000 3 00010000:00080000:0.0:1788970235.640160:0:19630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97787ea27800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.109@tcp at head 00010000:00010000:0.0:1788970235.648073:0:19630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788970235.648284:0:19630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788970235.648323:0:19630:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970235.648334:0:19630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d0de860b05b53bd 00000100:00080000:0.0:1788970235.648345:0:19630:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970235.648357:0:19630:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97787ea27800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970235.648395:0:19630:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce4f00 x1875870741551104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970235.648477:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741551104:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970235.648552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788970235.648810:0:19630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788970235.648833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970235.648838:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970235.648841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970235.648844:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788970235.649365:0:19630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788970235.649683:0:19607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788970235.649712:0:19607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970235.649737:0:19607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53af expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.649749:0:19607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff9778821dd200/0x5d0de860b05b53a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53af expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970235.650126:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788970235.650129:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970235.650131:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970235.650132:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970235.650133:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970235.650135:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970235.650137:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970235.650139:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970235.650140:0:19607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970235.650144:0:19607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788970235.650146:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970235.650147:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970235.650148:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970235.650149:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970235.650151:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970235.650152:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970235.650153:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970235.650154:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970235.650155:0:19607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970235.650178:0:19607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788970235.650208:0:19607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741551232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788970235.650264:0:19607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970235.650305:0:19607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970235.651922:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551104 00000100:00100000:2.0:1788970235.651935:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551104 00000100:00100000:2.0:1788970235.651981:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970235.651989:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875870741551104:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788970235.652016:0:18927:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:2.0:1788970235.652050:0:18927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d0de860b05b53c4 00000004:00100000:2.0:1788970235.652066:0:18927:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970235.652098:0:18927:0:(import.c:65:import_set_state_nolock()) ffff97787ea37800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970235.652172:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875870741551104:12345-0@lo:38:llog_process_th.0 Request processed in 182us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.652180:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970235.652215:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551232 00000100:00100000:2.0:1788970235.652219:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551232 00000100:00100000:2.0:1788970235.652250:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788970235.652256:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:19607:x1875870741551232:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970235.652278:0:18917:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788970235.652300:0:18917:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788970235.655001:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97787dce4f00 x1875870741551104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970235.655018:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970235.655030:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788970235.655039:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788970235.655045:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970235.655048:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97787ea27800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970235.655055:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875870741551104:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788970235.691935:0:18917:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970235.691947:0:18917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788970235.692014:0:18941:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788970235.692020:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788970235.692044:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.692062:0:18941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 16 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.692069:0:18941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.692105:0:18941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 16 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.692118:0:18941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 16 pid: 18920 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970235.692131:0:18941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741551360:0@lo:104: 00000100:00100000:1.0:1788970235.692201:0:18941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970235.692246:0:18941:0:(client.c:2716:ptlrpc_set_wait()) set ffff977847233c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788970235.693649:0:18908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551360 00000100:00100000:2.0:1788970235.693658:0:18908:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551360 00000100:00100000:2.0:1788970235.693842:0:18908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970235.693851:0:18908:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741551360:12345-0@lo:104: 00010000:00010000:2.0:1788970235.693866:0:18908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.693934:0:18908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970235.693939:0:18908:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741551360:12345-0@lo:104: Request processed in 91us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.693945:0:18908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788970235.694010:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970235.694016:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.694023:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:1.0:1788970235.694027:0:18914:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.694035:0:18914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970235.694052:0:18914:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970235.694058:0:18914:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970235.694097:0:18914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.694102:0:18914:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970235.694121:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.694127:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff977880f92200/0x5d0de860b05b5331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5338 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970235.694142:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970235.694143:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970235.694145:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970235.694162:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741551488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970235.694207:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970235.694272:0:18941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741551360:0@lo:104: 00010000:00010000:1.0:1788970235.694293:0:18941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970235.696866:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551488 00000100:00100000:3.0:1788970235.696881:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551488 00010000:00010000:3.0:1788970235.696917:0:18910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 17 pid: 18920 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970235.696976:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970235.696986:0:18910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:3286:x1875870741551488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970235.697002:0:18910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970235.697008:0:18910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 17 pid: 18920 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697021:0:18910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 17 pid: 18920 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697038:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9778821dd000/0x5d0de860b05b5338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b5331 expref: 17 pid: 18920 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697054:0:18910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697062:0:18910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788970235.697078:0:18910:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005059522s 00010000:00010000:3.0:1788970235.697083:0:18910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697089:0:18910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697095:0:18910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697102:0:18910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697114:0:18910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970235.697119:0:18910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697127:0:18910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697153:0:18910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970235.697164:0:18910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970235.697236:0:18910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3286:x1875870741551488:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970235.697243:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970235.697283:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741551488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970235.697571:0:18941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.697581:0:18941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970235.697588:0:18941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f92000/0x5d0de860b05b53cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970235.708382:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:19607:x1875870741551232:12345-0@lo:253:mount.lustre.0 Request processed in 56114us (58105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970235.708397:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788970235.708507:0:19607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:19607:1875870741551232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970235.708524:0:19607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788970235.708527:0:19607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970235.708529:0:19607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788970235.708530:0:19607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970235.708546:0:19607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970235.708547:0:19607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970235.708549:0:19607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970235.708550:0:19607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970235.708552:0:19607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970235.708554:0:19607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970235.708570:0:19607:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788970235.709219:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788970235.709364:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788970235.709500:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788970235.709630:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788970235.715260:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788970235.715528:0:19607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:3.0:1788970235.720128:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788970235.720566:0:19607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788970235.875931:0:19607:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788970235.875941:0:19607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788970235.878039:0:19607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788970235.878122:0:19607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788970235.878150:0:19607:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788970235.878196:0:19607:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788970236.741434:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970237.584254:0:18922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970237.584261:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787ef4d000 from 10 10000000:01000000:0.0:1788970237.584267:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970237.584316:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584328:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584340:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970237.584365:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741551616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970237.584428:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970237.584474:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551616 00000100:00100000:0.0:1788970237.584481:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551616 00000100:00100000:0.0:1788970237.584540:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970237.584549:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+15:18922:x1875870741551616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970237.584562:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970237.584575:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b53d2 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584597:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 16 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584609:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 16 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584617:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484600, rc 0) 00000100:00100000:0.0:1788970237.584650:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:18922:x1875870741551616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970237.584656:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788970237.584781:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785095c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970237.584822:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741551616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970237.584836:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970237.584845:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970237.584890:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741551744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970237.584919:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970237.584941:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff97785095c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970237.585154:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551744 00000100:00100000:2.0:1788970237.585159:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551744 00000100:00100000:2.0:1788970237.585204:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970237.585211:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:18922:x1875870741551744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788970237.585226:0:18917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970237.585242:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970237.585245:0:18917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788970237.585332:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:18922:x1875870741551744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970237.585340:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970237.585763:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741551744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788970237.585862:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970237.585870:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970237.585880:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970237.765513:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970238.793606:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970239.815980:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970240.838815:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970240.968010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970240.968018:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970240.968021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970240.968024:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970240.968073:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741552128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970240.968155:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970240.968491:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3283:1875870741551872:0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.968538:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970240.968566:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970240.968573:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741552000:0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.968596:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970240.968635:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552128 00000100:00100000:0.0:1788970240.968643:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552128 00000100:00100000:0.0:1788970240.968695:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552000 00000100:00100000:0.0:1788970240.968699:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552000 00000100:00100000:0.0:1788970240.968716:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970240.968724:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741552128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.968775:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741552128:12345-0@lo:400:kworker.0 Request processed in 53us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970240.968783:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970240.968823:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970240.968830:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741552000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.968863:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741552000:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970240.968870:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970240.968888:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741551872 00000100:00100000:0.0:1788970240.968892:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741551872 00000100:00100000:0.0:1788970240.968918:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970240.968924:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3283:x1875870741551872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.968953:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3283:x1875870741551872:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970240.968958:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788970240.969010:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff64780 x1875870741552000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970240.969039:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741552000:0@lo:400:kworker.0 00000100:00100000:0.0:1788970240.969051:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3283:1875870741551872:0@lo:400:kworker.0 00010000:00080000:0.0:1788970240.969085:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff64f00 x1875870741552128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970240.969094:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741552128:0@lo:400:kworker.0 00000100:00080000:2.0:1788970240.969227:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788970241.861340:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788970242.195901:0:19975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788970242.438509:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970242.895329:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970243.915905:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970244.933868:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970245.896866:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970230/real 1788970230] req@ffff97787ff66580 x1875870741548160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970245 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970245.896927:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787ff66580 x1875870741548160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970245 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970245.896938:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970230/real 1788970230] req@ffff97787ff64b40 x1875870741548288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970245 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970245.896950:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97787ff64b40 x1875870741548288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970245 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970245.896972:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970245.897008:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970245.897012:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741548160:0@lo:8:kworker.0 00000100:00080000:3.0:1788970245.897018:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970245.897024:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970245.897027:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741548288:0@lo:8:kworker.0 00000100:00080000:0.0:1788970245.897246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970245.897251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788970245.897254:0:36:0:(import.c:65:import_set_state_nolock()) ffff9778506c0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970245.897259:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1788970245.897265:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970245.897275:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9778506c0000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788970245.897293:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741552256:0@lo:400:kworker.0 00000100:00100000:0.0:1788970245.897295:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce7840 x1875870741552384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970245.897314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970245.897317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970245.897318:0:36:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970245.897322:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1788970245.897325:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970245.897329:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff977878834000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:0.0:1788970245.897339:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787dce6d00 x1875870741552512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970245.897371:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970245.897383:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741552640:0@lo:400:kworker.0 00000100:00100000:0.0:1788970245.897422:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970245.897442:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552256 00000100:00100000:0.0:1788970245.897442:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970245.897447:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741552768:0@lo:400:kworker.0 00000100:00100000:1.0:1788970245.897450:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552256 00000100:00100000:0.0:1788970245.897467:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970245.897494:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552640 00000100:00100000:1.0:1788970245.897497:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970245.897498:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552640 00000100:00100000:1.0:1788970245.897505:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3286:x1875870741552256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970245.897525:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552768 00000100:00100000:0.0:1788970245.897527:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552768 00000100:00100000:0.0:1788970245.897551:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970245.897553:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3286:x1875870741552256:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970245.897558:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741552640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970245.897560:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970245.897592:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875870741552640:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970245.897598:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970245.897610:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970245.897616:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741552768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970245.897678:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741552384:0@lo:8:kworker.0 00000100:00100000:1.0:1788970245.897821:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741552256:0@lo:400:kworker.0 00000100:00080000:1.0:1788970245.897871:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970245.900728:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875870741552768:12345-0@lo:400:kworker.0 Request processed in 3104us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970245.900744:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788970245.905139:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787dce5a40 x1875870741552640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970245.905159:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875870741552640:0@lo:400:kworker.0 00010000:00080000:1.0:1788970245.905317:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787dce43c0 x1875870741552768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970245.905381:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875870741552768:0@lo:400:kworker.0 00000100:00100000:2.0:1788970245.910915:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970245.910993:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741552512:0@lo:8:kworker.0 00000100:00100000:2.0:1788970245.911029:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970245.911261:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552384 00000100:00100000:0.0:1788970245.911270:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552384 00000100:00100000:0.0:1788970245.911309:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552512 00000100:00100000:0.0:1788970245.911312:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552512 00000100:00100000:0.0:1788970245.911325:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970245.911333:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741552384:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788970245.911362:0:19609:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1788970245.911393:0:19609:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b53e0 00002000:00100000:0.0:1788970245.911406:0:19609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97787ea20800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788970245.911411:0:19609:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788970245.911413:0:19609:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788970245.911982:0:19609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970245.912021:0:19609:0:(import.c:65:import_set_state_nolock()) ffff97787ea23800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970245.912084:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741552384:12345-0@lo:8:kworker.0 Request processed in 750us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970245.912105:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970245.912123:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970245.912128:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741552512:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788970245.912141:0:19609:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788970245.915888:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787dce7840 x1875870741552384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970245.915906:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970245.915934:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788970245.915943:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788970245.915950:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788970245.915954:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9778506c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788970245.915987:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788970245.915995:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741552384:0@lo:8:kworker.0 00000004:00080000:3.0:1788970245.916214:0:18947:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788970245.916548:0:18947:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 557879757675ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788970245.916742:0:18948:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788970245.916776:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18948:1875870741553024:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788970245.916869:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970245.916896:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f936c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970245.916909:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970245.916919:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741552896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970245.916943:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970245.916978:0:19612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741552896 00000100:00100000:1.0:1788970245.916985:0:19612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741552896 00000100:00100000:1.0:1788970245.917037:0:19612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970245.917053:0:19612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875870741552896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970245.917083:0:19612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970245.917141:0:19612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875870741552896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970245.917148:0:19612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788970245.917169:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970245.917190:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97787ff661c0 x1875870741552896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970245.917207:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741552896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970245.922345:0:19611:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788970245.922361:0:19611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788970245.922565:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553024 00000100:00100000:3.0:1788970245.922575:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553024 00000100:00100000:3.0:1788970245.922695:0:20138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970245.922705:0:20138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18948:x1875870741553024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788970245.926380:0:20138:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788970245.926391:0:20138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788970245.926395:0:20138:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:65) 00000100:00100000:0.0:1788970245.932319:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741552512:12345-0@lo:8:kworker.0 Request processed in 20185us (21284us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970245.932440:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788970245.932509:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970245.932515:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970245.932521:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741552512:0@lo:8:kworker.0 00002000:00010000:3.0:1788970245.951387:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.951404:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.951424:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.951429:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.951435:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.951454:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.951464:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.951471:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.951495:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970245.952514:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.952523:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.952534:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.952539:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.952549:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.952573:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.952580:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d4d7d9/0x5d0de860b05b53e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.952586:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.952591:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.952602:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.952606:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.952612:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.952625:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.952627:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.952628:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.952630:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.952638:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.952645:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.952674:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.953175:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.953182:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953192:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.953195:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.953199:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953208:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953216:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953234:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953247:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788970245.953626:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.953632:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953641:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.953644:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.953648:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953657:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953664:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953670:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.953678:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788970245.954085:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.954100:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.954115:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.954118:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.954123:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.954131:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.954139:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.954146:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.954155:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788970245.955208:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.955217:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955228:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.955232:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.955238:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955249:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955267:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955274:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955282:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788970245.955663:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.955669:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955677:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.955680:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.955684:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955693:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955701:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955707:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.955725:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788970245.957427:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788970245.957440:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957452:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957457:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957468:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957488:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957496:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f76017/0x5d0de860b05b53ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957529:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788970245.957534:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957540:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957556:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957564:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957574:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957580:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b85e43c5/0x5d0de860b05b53f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957594:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788970245.957598:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957604:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957607:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957614:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957624:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957631:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b53fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957649:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788970245.957652:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957658:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957661:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957668:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957677:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957684:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957695:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.957699:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957705:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957707:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957724:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957732:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957739:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b540a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957748:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.957751:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957756:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.957758:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957765:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957773:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957780:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5411 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.957823:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.957825:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.957827:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.957853:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.958545:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.958555:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.958567:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.958571:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.958577:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.958590:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.958600:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.958608:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.958622:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.959483:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.959490:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959500:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.959509:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.959513:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959523:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959530:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959537:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959546:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788970245.959938:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.959944:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959952:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.959955:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.959959:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959968:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959975:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959988:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.959996:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788970245.961234:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788970245.961246:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961258:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.961263:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961273:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961292:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961299:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b5418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961318:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.961321:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961327:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.961336:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961344:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961355:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961361:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b541f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961375:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.961379:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961384:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.961387:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961393:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961401:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961407:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b5426 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.961430:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.961432:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.961434:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.961441:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.961589:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.961596:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.961608:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.961613:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.961619:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.961629:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.961638:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.961645:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.961749:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.962326:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.962333:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.962348:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.962351:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.962356:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.962365:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.962373:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.962381:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967612:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.967630:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967645:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.967650:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967662:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967684:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967691:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b542d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967740:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.967745:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967752:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.967767:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967775:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967786:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.967890:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.967891:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.967893:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.969494:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.969506:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5434 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.970274:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.970347:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.970355:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.970371:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.970376:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.970382:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.970412:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.970422:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.970429:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.970450:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970245.971284:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.971294:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.971306:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.971311:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.971320:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.971338:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.971345:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac6b7af4/0x5d0de860b05b543b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.971375:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.971377:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.971379:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.972381:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.972392:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.972405:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.972410:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.972417:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.972430:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.972438:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.972458:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.972522:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.972999:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.973350:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.973362:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.973366:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.973371:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.973380:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.973388:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.973396:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973740:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.973748:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973756:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.973760:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973769:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973784:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973816:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b5442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973840:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.973844:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973850:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.973861:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973869:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973880:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.973888:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.973890:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.973892:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788970245.973972:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788970245.974408:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.974414:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.975126:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.975134:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.975217:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.975222:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.975229:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.975241:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.975251:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.975258:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975419:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.975426:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975433:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.975437:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975446:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975460:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975468:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.975476:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.975478:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.975720:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.975726:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b5450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.975885:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.976553:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.976559:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.976581:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.976586:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.976664:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.976676:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.976685:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.976693:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.976759:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.977308:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.977315:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.977324:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.977328:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.977331:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.977341:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.977360:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.977367:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977638:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.977647:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977656:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.977660:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977669:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977687:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977695:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b5457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977720:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.977724:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977730:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.977733:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977753:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977764:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.977772:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.977773:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.977776:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.978232:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.978270:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.978276:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b545e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.979141:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.979213:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.979227:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.979232:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.979238:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.979250:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.979260:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.979280:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.979303:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970245.979688:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.979695:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.979703:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.979708:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.979717:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.979733:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.979740:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c6d6c4/0x5d0de860b05b5465 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.979771:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.979773:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.979775:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.980317:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.980325:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980336:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.980339:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.980345:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980355:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980363:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980371:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980430:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.980889:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.980894:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980910:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.980913:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.980918:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980928:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980937:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.980944:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981169:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970245.981176:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981184:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.981188:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981196:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981211:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981219:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a25b71/0x5d0de860b05b546c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981240:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.981243:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981249:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.981258:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981266:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981278:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981285:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.981287:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.981289:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.981415:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.981421:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b5473 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.981662:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.983239:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.983248:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983262:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.983266:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.983272:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983295:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983304:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983311:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983369:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.983773:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.983779:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983805:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.983809:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.983813:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983823:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983831:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.983849:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984474:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970245.984483:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984492:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.984497:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984507:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984530:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984538:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000791e3b87/0x5d0de860b05b547a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984564:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970245.984568:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984764:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.984769:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984777:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984824:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.984832:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.984834:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.984836:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.984964:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.984969:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d88b9f0/0x5d0de860b05b5481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.985672:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.985680:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.985692:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.985696:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.985702:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.985713:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.985722:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.985730:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.985917:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.985924:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.985932:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.985935:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.985944:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.985958:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.985966:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.985974:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.985976:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.986053:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.986058:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43081b7/0x5d0de860b05b5488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.986688:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.986694:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.986704:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.986708:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.986714:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.986724:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.986733:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.986741:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.986822:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970245.986829:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.986837:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.986841:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.986850:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.986864:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.986882:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.986884:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.986886:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.987247:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.987253:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f826b00/0x5d0de860b05b548f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.987731:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.987737:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.987748:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.987752:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.987757:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.987767:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.987775:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.987783:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.988004:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.988011:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.988019:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.988023:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.988031:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.988046:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.988054:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.988055:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.988057:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.988221:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.988227:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250bb3ea/0x5d0de860b05b5496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.988737:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.988744:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.988766:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.988771:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.988776:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.988968:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.988979:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.988988:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.989051:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970245.989057:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.989065:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.989068:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.989076:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.989099:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.989107:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.989108:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.989110:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.989286:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.989291:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729e98d5/0x5d0de860b05b549d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.989937:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.989945:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.989955:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.989959:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.989964:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.989986:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.989995:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.990001:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.990054:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.990061:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.990068:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.990071:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.990080:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.990110:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.990120:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.990122:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.990124:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.990343:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.990348:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3947fd/0x5d0de860b05b54a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.990676:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.990955:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.990961:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.990971:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.990975:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.990981:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.990991:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.991009:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.991016:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.991032:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970245.991294:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.991300:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.991307:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.991311:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.991320:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.991334:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.991341:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cc3af5/0x5d0de860b05b54ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.991355:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.991357:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970245.991359:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970245.992642:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.992652:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.992665:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.992669:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.992675:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.992686:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.992695:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.992702:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.992765:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970245.993307:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.993313:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.993322:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.993325:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.993329:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.993338:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.993346:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.993353:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993402:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970245.993409:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993417:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.993427:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993437:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993453:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993461:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb66f76/0x5d0de860b05b54b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993488:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970245.993491:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993498:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970245.993502:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993509:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993518:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970245.993526:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.993533:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970245.993534:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.993770:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.993776:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cdf1647/0x5d0de860b05b54b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970245.994377:0:20138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788970245.994383:0:20138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.994402:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:3.0:1788970245.994406:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970245.994411:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.994423:0:20138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.994433:0:20138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970245.994440:0:20138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.994500:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970245.994507:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.994514:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970245.994518:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.994526:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970245.994539:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970245.994701:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970245.994703:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970245.994705:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970245.994764:0:20138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970245.994769:0:20138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca00c45/0x5d0de860b05b54c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788970245.995538:0:20138:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788970245.995656:0:20138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18948:x1875870741553024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72948us (78782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970245.995666:0:20138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970245.995887:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18948:1875870741553024:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788970245.995908:0:18948:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788970245.995954:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18948:1875870741553152:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788970245.995988:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970245.996032:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778503fdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970245.996130:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553152 00000100:00100000:3.0:1788970245.996137:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553152 00000100:00100000:3.0:1788970245.996252:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970245.996263:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18948:x1875870741553152:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788970245.996318:0:19611:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:2.0:1788970246.000681:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970246.002709:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18948:x1875870741553152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6443us (6715us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788970246.002722:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970246.002955:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18948:1875870741553152:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788970246.002972:0:18948:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000001:00100000:0.0:1788970246.211618:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788970246.211637:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:0.0:1788970246.981368:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970248.005281:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970249.031013:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970249.797486:0:20328:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970249.797490:0:20328:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788970249.797621:0:20328:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97787ea5a000 00000020:01000004:3.0:1788970249.797656:0:20328:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788970249.797670:0:20328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788970249.797683:0:20328:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9778652f99c0) 00000020:00000080:3.0:1788970249.797700:0:20328:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788970249.830367:0:20328:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788970249.830767:0:20328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788970249.832580:0:20328:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788970249.833312:0:20328:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788970249.835851:0:20328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788970249.837170:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 211: rc = 0 00100000:10000000:0.0:1788970249.837286:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 211: rc = 0 00100000:10000000:0.0:1788970249.837367:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 211: rc = 0 00100000:10000000:0.0:1788970249.839298:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:0.0:1788970249.840411:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 644: rc = 0 00100000:10000000:0.0:1788970249.841413:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:1.0:1788970249.849255:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 644: rc = 0 00100000:10000000:1.0:1788970249.849828:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 644: rc = 0 00100000:10000000:1.0:1788970249.850168:0:20328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 644: rc = 0 00000020:00000080:1.0:1788970249.851017:0:20328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788970249.851030:0:20328:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970249.851040:0:20328:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b54ce 00000020:01000004:1.0:1788970249.851048:0:20328:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788970249.851078:0:20328:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788970249.851081:0:20328:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788970249.851088:0:20328:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788970249.851109:0:20328:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788970249.851113:0:20328:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788970249.870402:0:20328:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788970249.870438:0:20328:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.109@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788970249.870443:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788970249.870445:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970249.870446:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970249.870448:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970249.870449:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970249.870450:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970249.870451:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970249.870453:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970249.870454:0:20328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788970249.870458:0:20328:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788970249.870460:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970249.870461:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788970249.870462:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970249.870463:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970249.870464:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970249.870465:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970249.870466:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788970249.870467:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970249.870468:0:20328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788970249.870503:0:20328:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788970249.870645:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553280:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788970249.871268:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970249.871326:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.871412:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553280 00000100:00100000:0.0:1788970249.871421:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553280 00000100:00100000:0.0:1788970249.871476:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788970249.871485:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:20328:x1875870741553280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970249.871549:0:18917:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788970249.871552:0:18917:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788970249.871556:0:18917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788970249.886395:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:20328:x1875870741553280:12345-0@lo:253:mount.lustre.0 Request processed in 14901us (15117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970249.886430:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970249.886519:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970249.886536:0:20328:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788970249.886539:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970249.886540:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970249.886541:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970249.886543:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970249.886544:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970249.886545:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970249.886547:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970249.886549:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970249.886550:0:20328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788970249.886634:0:20328:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97787ea5a000 from lustre-OST0001 10000000:01000000:2.0:1788970249.886707:0:20328:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788970249.886710:0:20328:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788970249.886719:0:20328:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff977741984d40 local copy 00010000:00010000:2.0:1788970249.886730:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970249.887074:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970249.887111:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.887187:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970249.887262:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553408 00000100:00100000:1.0:1788970249.887269:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553408 00000100:00100000:1.0:1788970249.887342:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970249.887351:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:20328:x1875870741553408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970249.887531:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:20328:x1875870741553408:12345-0@lo:501:mount.lustre.0 Request processed in 181us (419us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970249.887539:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970249.887605:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553408:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788970249.887619:0:20328:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788970249.887761:0:20328:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788970249.887767:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970249.887786:0:20328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977880f93000/0x5d0de860b05b5258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b525f expref: -99 pid: 18907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970249.887831:0:20328:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97787ea5a000 10000000:01000000:2.0:1788970249.887837:0:20328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788970249.887842:0:20328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788970249.887845:0:20328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970249.887849:0:20328:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788970249.887852:0:20328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788970249.887876:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970249.887884:0:20328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970249.887892:0:20328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970249.887905:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970249.887930:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.888302:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.888341:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553536 00000100:00100000:0.0:1788970249.888346:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553536 00000100:00100000:0.0:1788970249.888370:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788970249.888377:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:20328:x1875870741553536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970249.888386:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970249.888400:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97787f484a00/0x5d0de860b05b54dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b54d5 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.888423:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f484a00/0x5d0de860b05b54dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b54d5 expref: 17 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.888434:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97787f484a00/0x5d0de860b05b54dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b54d5 expref: 17 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.888443:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97787f484a00, rc 0) 00000100:00100000:0.0:1788970249.888530:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553536:12345-0@lo:101:mount.lustre.0 Request processed in 152us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.888547:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788970249.888727:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970249.888743:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54dc expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970249.888752:0:20328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b54dc expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970249.889733:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788970249.892397:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970249.895870:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788970249.895971:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788970249.897168:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788970249.897294:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788970249.897333:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788970249.897368:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788970249.897431:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788970249.897474:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788970249.897519:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788970249.897592:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788970249.897600:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788970249.897714:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970249.897784:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.897856:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.897870:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553664 00000100:00100000:0.0:1788970249.897878:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553664 00000100:00100000:0.0:1788970249.897942:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970249.897956:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970249.898346:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553664:12345-0@lo:501:mount.lustre.0 Request processed in 394us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.898354:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788970249.898515:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970249.898551:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970249.898591:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.898617:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.898647:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553792 00000100:00100000:0.0:1788970249.898652:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553792 00000100:00100000:0.0:1788970249.898687:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788970249.898694:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970249.898999:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553792:12345-0@lo:503:mount.lustre.0 Request processed in 305us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.899006:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970249.899147:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970249.900105:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970249.900189:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970249.900238:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970249.900272:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970249.900439:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741553920 00000100:00100000:2.0:1788970249.900446:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741553920 00000100:00100000:2.0:1788970249.900477:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970249.900485:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970249.900697:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741553920:12345-0@lo:502:mount.lustre.0 Request processed in 213us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970249.900704:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788970249.900927:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741553920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970249.901169:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788970249.901219:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788970249.901252:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788970249.901301:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788970249.901336:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788970249.901370:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788970249.901426:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788970249.901460:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788970249.901508:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788970249.901538:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970249.901665:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970249.901720:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970249.902119:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554048 00000100:00100000:2.0:1788970249.902126:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554048 00000100:00100000:2.0:1788970249.902260:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970249.902272:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741554048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970249.902557:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741554048:12345-0@lo:502:mount.lustre.0 Request processed in 287us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.902627:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970249.902713:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788970249.902725:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788970249.904101:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970249.904113:0:20329:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788970249.904120:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970249.904122:0:20329:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788970249.904128:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970249.904146:0:20329:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff977880b34d40) 00000020:00000080:0.0:1788970249.904171:0:20329:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788970249.904176:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788970249.904266:0:20329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787ea5a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788970249.904280:0:20329:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788970249.904288:0:20329:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d0de860b05b54ea 00000100:00100000:2.0:1788970249.906996:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1788970249.909770:0:20329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788970249.910345:0:20329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:0.0:1788970249.914003:0:20329:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788970249.915685:0:20329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788970249.915701:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970249.915709:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970249.915711:0:20329:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788970249.915716:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970249.915721:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970249.915722:0:20329:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788970249.915726:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788970249.915728:0:20329:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788970249.915731:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970249.915734:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970249.915736:0:20329:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788970249.915739:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970249.915742:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970249.915744:0:20329:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788970249.915748:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788970249.915865:0:20329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970249.915869:0:20329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970249.915871:0:20329:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788970249.915874:0:20329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788970249.916907:0:20328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788970249.916942:0:20328:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788970249.916957:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54dc expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.916970:0:20328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977840030a00/0x5d0de860b05b54d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54dc expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970249.916979:0:20328:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787ea5a000 from 1 10000000:01000000:0.0:1788970249.916981:0:20328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970249.917019:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.917026:0:20328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.917036:0:20328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970249.917072:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970249.917141:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970249.917192:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788970249.917308:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554176 00000100:00100000:1.0:1788970249.917317:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554176 00000100:00100000:1.0:1788970249.917387:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788970249.917396:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:20328:x1875870741554176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970249.917410:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970249.917423:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b54f1 expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970249.917449:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 18 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970249.917461:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 18 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970249.917469:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:1.0:1788970249.917929:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554176:12345-0@lo:101:mount.lustre.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970249.917938:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788970249.917995:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970249.918012:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970249.918021:0:20328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970249.920048:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788970249.924043:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970249.924336:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788970249.924373:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788970249.924412:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788970249.924441:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788970249.924486:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788970249.924543:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788970249.924586:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788970249.924613:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788970249.924668:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788970249.924677:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788970249.924758:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970249.924839:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970249.924877:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970249.928262:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554304 00000100:00100000:2.0:1788970249.928278:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554304 00000100:00100000:2.0:1788970249.928346:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788970249.928356:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970249.928659:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f445450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554304:12345-0@lo:501:mount.lustre.0 Request processed in 304us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970249.928667:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788970249.929626:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970249.929685:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970249.929754:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970249.929784:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970249.930603:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554432 00000100:00100000:2.0:1788970249.930611:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554432 00000100:00100000:2.0:1788970249.930664:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970249.930673:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970249.931067:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554432:12345-0@lo:503:mount.lustre.0 Request processed in 394us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970249.931076:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788970249.931332:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970249.932591:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970249.932669:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970249.932742:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970249.932854:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970249.937332:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554560 00000100:00100000:2.0:1788970249.937348:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554560 00000100:00100000:3.0:1788970249.938003:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970249.938015:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970249.939573:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554560:12345-0@lo:502:mount.lustre.0 Request processed in 1554us (6823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970249.939586:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788970249.940677:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970249.942480:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788970249.943378:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788970249.943447:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788970249.943483:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788970249.943514:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788970249.943689:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788970249.943731:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788970249.943765:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788970249.943954:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970249.944034:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970249.944137:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977845391e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970249.951232:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554688 00000100:00100000:3.0:1788970249.951246:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554688 00000100:00100000:3.0:1788970249.951315:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970249.951326:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970249.952026:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554688:12345-0@lo:502:mount.lustre.0 Request processed in 700us (7989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970249.952036:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788970249.952458:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970249.952709:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788970249.952736:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788970249.955466:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970249.955480:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970249.955482:0:20333:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788970249.955489:0:20333:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787ea5a000 00000020:00000080:3.0:1788970249.955492:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970249.955499:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970249.955501:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970249.955503:0:20333:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788970249.955505:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970249.955507:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970249.955508:0:20333:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788970249.955512:0:20333:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97787ea5a000 00000020:00000080:3.0:1788970249.955514:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788970249.955677:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970249.955682:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970249.955684:0:20333:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788970249.955686:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970249.955702:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970249.955703:0:20333:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788970249.955707:0:20333:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97787ea5a000 00000020:00000080:3.0:1788970249.955710:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970249.969185:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970249.969199:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970249.969201:0:20333:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788970249.969206:0:20333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788970249.971453:0:20328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788970249.971500:0:20328:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970249.971520:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.971534:0:20328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970249.975465:0:20328:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970249.975472:0:20328:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97787ea5a000 10000000:01000000:0.0:1788970249.975476:0:20328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97787ea5a000 10000000:01000000:0.0:1788970249.975480:0:20328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970249.975487:0:20328:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97787ea5a000 from 1 10000000:01000000:0.0:1788970249.975490:0:20328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970249.975532:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.975545:0:20328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970249.975568:0:20328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970249.975592:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970249.975655:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970249.975701:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970249.977709:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554816 00000100:00100000:3.0:1788970249.977722:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554816 00000100:00100000:3.0:1788970249.977780:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970249.977805:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741554816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970249.977824:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970249.977842:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff5800/0x5d0de860b05b5506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b54ff expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970249.977880:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff5800/0x5d0de860b05b5506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b54ff expref: 19 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970249.977891:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff5800/0x5d0de860b05b5506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b54ff expref: 19 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970249.977900:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5800, rc 0) 00000100:00100000:3.0:1788970249.977967:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741554816:12345-0@lo:101:mount.lustre.0 Request processed in 179us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970249.977974:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970249.978036:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970249.978063:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5506 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970249.978072:0:20328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5506 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970249.984445:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788970249.985202:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970249.985461:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788970249.985504:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788970249.985538:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788970249.985653:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788970249.985691:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788970249.985748:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788970249.985777:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788970249.985828:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788970249.986660:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788970249.986722:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788970249.986760:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788970249.986828:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788970249.987647:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788970249.987707:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788970249.987767:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788970249.987828:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788970249.988637:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788970249.988712:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788970249.988751:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788970249.988786:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788970249.991028:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788970249.991098:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788970249.991134:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788970249.991183:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788970249.991221:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788970249.991251:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788970249.991280:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788970249.991298:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788970249.991314:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788970249.991341:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788970249.991359:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788970249.991375:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788970249.991407:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788970249.991455:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788970249.991487:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788970249.991515:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788970249.991533:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788970249.992759:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788970249.992852:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788970249.992897:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788970249.993014:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788970249.993022:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788970249.993129:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970249.993194:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970249.993244:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861da3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.993661:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741554944 00000100:00100000:0.0:1788970249.993670:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741554944 00000100:00100000:0.0:1788970249.993727:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970249.993737:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741554944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970249.994260:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741554944:12345-0@lo:501:mount.lustre.0 Request processed in 523us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.994268:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788970249.994333:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741554944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970249.994381:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970249.994484:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.994546:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c2740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970249.994581:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555072 00000100:00100000:3.0:1788970249.994586:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555072 00000100:00100000:3.0:1788970249.994651:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788970249.994659:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977847215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970249.995258:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977847215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555072:12345-0@lo:503:mount.lustre.0 Request processed in 599us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970249.995267:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788970249.995331:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970249.997226:0:20328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970249.997310:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970249.997380:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970249.997492:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c2740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970249.997643:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555200 00000100:00100000:0.0:1788970249.997650:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555200 00000100:00100000:0.0:1788970249.997704:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970249.997714:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970249.998322:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555200:12345-0@lo:502:mount.lustre.0 Request processed in 609us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970249.998330:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788970249.998633:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970249.999264:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788970249.999319:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788970249.999352:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788970249.999413:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788970249.999453:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788970249.999500:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788970249.999536:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788970249.999570:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788970249.999632:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788970249.999689:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788970249.999721:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788970249.999763:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788970249.999813:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788970249.999850:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788970249.999915:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788970249.999952:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788970249.999981:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788970250.000020:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788970250.000047:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788970250.000089:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788970250.000150:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788970250.000189:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788970250.000223:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788970250.000271:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788970250.000307:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788970250.000340:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788970250.000388:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788970250.000421:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788970250.000452:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788970250.000492:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788970250.000535:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788970250.000565:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788970250.000598:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788970250.000646:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788970250.000678:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788970250.000716:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788970250.000745:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788970250.000772:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788970250.000838:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788970250.000872:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788970250.000914:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970250.000986:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.001028:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861da3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.001707:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555328 00000100:00100000:0.0:1788970250.001715:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555328 00000100:00100000:0.0:1788970250.001769:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788970250.001779:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970250.002517:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741555328:12345-0@lo:502:mount.lustre.0 Request processed in 737us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.002526:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788970250.002540:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741555328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970250.002637:0:20328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788970250.002654:0:20328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788970250.003995:0:20338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788970250.004013:0:20338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff977879a899c0) 00000020:00000080:2.0:1788970250.004039:0:20338:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788970250.004134:0:20338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97787ea5a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788970250.004138:0:20338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97787ea5a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788970250.004140:0:20338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97787ea5a000 3 00010000:00080000:2.0:1788970250.004168:0:20338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97774248e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.109@tcp at head 00010000:00010000:2.0:1788970250.006935:0:20338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788970250.007829:0:20338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788970250.007872:0:20338:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970250.007884:0:20338:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d0de860b05b5514 00000100:00080000:2.0:1788970250.007895:0:20338:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970250.007906:0:20338:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97774248e800 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:2.0:1788970250.007940:0:20338:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9778812e03c0 x1875870741555456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970250.007970:0:20338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970250.008098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970250.008103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970250.008105:0:36:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970250.008110:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1788970250.008114:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788970250.008120:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff977878834000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:3.0:1788970250.008133:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97784eb8f0c0 x1875870741555712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970250.008174:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970250.008186:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741555584:0@lo:400:kworker.0 00000100:00100000:3.0:1788970250.008245:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.008283:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741555968:0@lo:400:kworker.0 00000100:00100000:3.0:1788970250.008311:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.008328:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970250.008332:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741555840:0@lo:400:kworker.0 00000100:00100000:3.0:1788970250.008351:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.008376:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555584 00000100:00100000:3.0:1788970250.008382:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555584 00000100:00100000:3.0:1788970250.008430:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970250.008439:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970250.008501:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741555584:12345-0@lo:400:kworker.0 Request processed in 64us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.008509:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970250.008545:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788970250.008561:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741555584:0@lo:400:kworker.0 00000100:00100000:1.0:1788970250.008974:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741555456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970250.009096:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.009136:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741555712:0@lo:8:kworker.0 00000100:00100000:1.0:1788970250.009178:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970250.009203:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555968 00000100:00100000:3.0:1788970250.009209:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555968 00000100:00100000:1.0:1788970250.009213:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555840 00000100:00100000:1.0:1788970250.009216:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555840 00000100:00100000:1.0:1788970250.009233:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555456 00000100:00100000:1.0:1788970250.009234:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555456 00000100:00100000:3.0:1788970250.009236:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970250.009242:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741555840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970250.009243:0:18925:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788970250.009250:0:18925:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788970250.009262:0:18927:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788970250.009270:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970250.009276:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741555968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970250.009277:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741555840:12345-0@lo:400:kworker.0 Request processed in 36us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.009283:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970250.009294:0:18926:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788970250.009300:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970250.009303:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875870741555968:12345-0@lo:400:kworker.0 Request processed in 29us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970250.009304:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875870741555456:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970250.009308:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788970250.009323:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788970250.009324:0:18926:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000100:00080000:1.0:1788970250.009328:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970250.009341:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741555712 00000100:00100000:1.0:1788970250.009344:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741555712 00000020:00000080:3.0:1788970250.009352:0:18926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d0de860b05b551b 00000100:00100000:1.0:1788970250.009360:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970250.009364:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875870741555712:12345-0@lo:8:kworker.0 00000004:00100000:3.0:1788970250.009366:0:18926:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788970250.009391:0:18926:0:(import.c:65:import_set_state_nolock()) ffff977742721800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970250.009398:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875870741555712:12345-0@lo:8:kworker.0 Request processed in 33us (220us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788970250.009404:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970250.009435:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875870741555456:12345-0@lo:38:llog_process_th.0 Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.009437:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788970250.009441:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788970250.009442:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970250.009445:0:3282:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788970250.009448:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741555712:0@lo:8:kworker.0 00010000:00080000:3.0:1788970250.009466:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97784eb8c3c0 x1875870741555840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788970250.009466:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9778812e03c0 x1875870741555456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.009475:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788970250.009476:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741555840:0@lo:400:kworker.0 00000100:00080000:1.0:1788970250.009479:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788970250.009486:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788970250.009489:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970250.009491:0:3282:0:(import.c:65:import_set_state_nolock()) ffff97774248e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:3.0:1788970250.009494:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97784eb8cf00 x1875870741555968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970250.009496:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875870741555456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970250.009503:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875870741555968:0@lo:400:kworker.0 00000040:00080000:2.0:1788970250.021411:0:20338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1788970250.021565:0:20328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788970250.021594:0:20328:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970250.021617:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5506 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970250.029912:0:20328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485e00/0x5d0de860b05b54ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5506 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970250.031171:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970250.031178:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970250.031180:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970250.031181:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970250.031182:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970250.031184:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970250.031185:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970250.031187:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970250.031188:0:20328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970250.031192:0:20328:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788970250.031195:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970250.031196:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970250.031197:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970250.031198:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970250.031198:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970250.031199:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970250.031200:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970250.031201:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970250.031202:0:20328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970250.031232:0:20328:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788970250.031255:0:20328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741556096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970250.031328:0:20328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970250.031374:0:20328:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.031429:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556096 00000100:00100000:0.0:1788970250.031436:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556096 00000100:00100000:0.0:1788970250.031489:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788970250.031498:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:20328:x1875870741556096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970250.031524:0:18919:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788970250.031549:0:18919:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788970250.054679:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788970250.059601:0:18919:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788970250.059616:0:18919:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788970250.059647:0:18941:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970250.059651:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970250.059688:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.059709:0:18941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 19 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.059718:0:18941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.059757:0:18941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 19 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.059774:0:18941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 19 pid: 18919 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970250.059820:0:18941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741556224:0@lo:104: 00000100:00100000:0.0:1788970250.059891:0:18941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970250.059934:0:18941:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970250.061949:0:18909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556224 00000100:00100000:0.0:1788970250.061966:0:18909:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556224 00000100:00100000:0.0:1788970250.062037:0:18909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970250.062047:0:18909:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741556224:12345-0@lo:104: 00010000:00010000:0.0:1788970250.062074:0:18909:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062198:0:18909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970250.062205:0:18909:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:18941:x1875870741556224:12345-0@lo:104: Request processed in 160us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970250.062213:0:18909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970250.062263:0:18941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18941:1875870741556224:0@lo:104: 00010000:00010000:0.0:1788970250.062295:0:18941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062707:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970250.062715:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062724:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:0.0:1788970250.062729:0:18913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062738:0:18913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970250.062746:0:18913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970250.062752:0:18913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970250.062805:0:18913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062811:0:18913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970250.062837:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062845:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f485a00/0x5d0de860b05b53d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53d9 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970250.062867:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970250.062869:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970250.062871:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970250.062883:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970250.062897:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741556352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970250.062932:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970250.063160:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556352 00000100:00100000:1.0:1788970250.063166:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556352 00010000:00010000:1.0:1788970250.063189:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 20 pid: 18919 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.063217:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970250.063223:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+20:3286:x1875870741556352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970250.063235:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970250.063241:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 20 pid: 18919 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063253:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 20 pid: 18919 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063267:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f484600/0x5d0de860b05b53d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b53d2 expref: 20 pid: 18919 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063288:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063297:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970250.063311:0:18912:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005059522s 00010000:00010000:1.0:1788970250.063316:0:18912:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063323:0:18912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063330:0:18912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063335:0:18912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063340:0:18912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970250.063344:0:18912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063352:0:18912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063366:0:18912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063374:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970250.063409:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3286:x1875870741556352:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.063417:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970250.063451:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741556352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970250.063471:0:18941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063478:0:18941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970250.063484:0:18941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f485800/0x5d0de860b05b5522 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970250.072783:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:20328:x1875870741556096:12345-0@lo:253:mount.lustre.0 Request processed in 41276us (41445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970250.072820:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970250.073141:0:20328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:629abde5-c42a-46d1-8386-6aff8bcfd1f0:20328:1875870741556096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970250.073156:0:20328:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788970250.073159:0:20328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970250.073161:0:20328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970250.073163:0:20328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970250.073164:0:20328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970250.073165:0:20328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970250.073167:0:20328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970250.073168:0:20328:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970250.073170:0:20328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970250.073171:0:20328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970250.073193:0:20328:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788970250.073752:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970250.074322:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970250.074496:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970250.075080:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788970250.075220:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788970250.075379:0:20328:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788970250.076756:0:20328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788970250.148333:0:20328:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788970250.148342:0:20328:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788970250.148373:0:20328:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788970250.148437:0:20328:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788970250.148451:0:20328:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788970250.148479:0:20328:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788970251.078512:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970251.218953:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741556480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970251.219023:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970251.225120:0:19612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556480 00000100:00100000:3.0:1788970251.225137:0:19612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556480 00000100:00100000:3.0:1788970251.225627:0:19612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970251.225639:0:19612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741556480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970251.225678:0:19612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970251.225777:0:19612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787ff670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741556480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (6754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970251.225785:0:19612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970251.225896:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741556480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788970252.101044:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788970252.101110:0:18922:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970252.101114:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97787ef4d000 from 11 10000000:01000000:0.0:1788970252.101120:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970252.101162:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970252.101174:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970252.101186:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970252.101211:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741556608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970252.101282:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970252.101343:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977877f5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970252.101394:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556608 00000100:00100000:3.0:1788970252.101403:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556608 00000100:00100000:3.0:1788970252.101470:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788970252.101481:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741556608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970252.101497:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970252.101522:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977852ff4000/0x5d0de860b05b5530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b5529 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970252.101570:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977852ff4000/0x5d0de860b05b5530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b5529 expref: 19 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970252.101582:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977852ff4000/0x5d0de860b05b5530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b5529 expref: 19 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970252.101592:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4000, rc 0) 00000100:00100000:3.0:1788970252.101651:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741556608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970252.101659:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788970252.101841:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741556608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970252.101854:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5530 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970252.101864:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b5530 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970252.101914:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741556736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970252.101944:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970252.101971:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970252.102103:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556736 00000100:00100000:3.0:1788970252.102107:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556736 00000100:00100000:3.0:1788970252.102139:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970252.102144:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741556736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970252.102156:0:18919:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970252.102171:0:18919:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970252.102173:0:18919:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788970252.102235:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741556736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970252.102242:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788970252.102296:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741556736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788970252.102343:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970252.102349:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5530 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970252.102357:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff97787f485400/0x5d0de860b05b5529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b5530 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970252.678786:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788970253.148853:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970254.153837:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.173010:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970255.303231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970255.303238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788970255.303241:0:36:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970255.303257:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff977878834000 using connection 192.168.202.109@tcp/0@lo 00000100:00100000:1.0:1788970255.303277:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97787ff66d00 x1875870741557120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970255.303343:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741556992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303407:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303475:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788970255.303481:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741556864:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303511:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303534:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741557504:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303558:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303581:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741557120:0@lo:8:kworker.0 00000100:00100000:1.0:1788970255.303602:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303636:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741557248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303658:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303676:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970255.303681:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741557376:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303702:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.303731:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556992 00000100:00100000:1.0:1788970255.303738:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556992 00000100:00100000:1.0:1788970255.303785:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557120 00000100:00100000:1.0:1788970255.303811:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557120 00000100:00100000:1.0:1788970255.303830:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970255.303840:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741556992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.303889:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741556992:12345-0@lo:400:kworker.0 Request processed in 51us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.303896:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970255.303912:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970255.303916:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875870741557120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788970255.303938:0:19609:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:1.0:1788970255.303965:0:19609:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d0de860b05b5537 00002000:00100000:1.0:1788970255.303977:0:19609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97784fd73000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788970255.303981:0:19609:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788970255.303984:0:19609:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788970255.304314:0:19609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788970255.304336:0:19609:0:(import.c:65:import_set_state_nolock()) ffff97784fd70000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970255.304375:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875870741557120:12345-0@lo:8:kworker.0 Request processed in 457us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.304382:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970255.304403:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741556864 00000100:00100000:1.0:1788970255.304413:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741556864 00000100:00100000:1.0:1788970255.304440:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788970255.304446:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3284:x1875870741556864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.304475:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3284:x1875870741556864:12345-0@lo:400:kworker.0 Request processed in 29us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.304481:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788970255.304504:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557504 00000100:00100000:1.0:1788970255.304508:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557504 00000100:00100000:1.0:1788970255.304530:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557248 00000100:00100000:1.0:1788970255.304533:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557248 00000100:00100000:1.0:1788970255.304543:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557376 00000100:00100000:1.0:1788970255.304545:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557376 00000100:00100000:1.0:1788970255.304557:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970255.304564:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741557504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.304590:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741557504:12345-0@lo:400:kworker.0 Request processed in 27us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.304596:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970255.304606:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970255.304612:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741557248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.304639:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741557248:12345-0@lo:400:kworker.0 Request processed in 28us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.304646:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970255.304656:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970255.304662:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741557376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.304686:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741557376:12345-0@lo:400:kworker.0 Request processed in 25us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.304691:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788970255.304721:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970255.304726:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970255.304762:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff66d00 x1875870741557120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970255.304779:0:3282:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788970255.304786:0:3282:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970255.304815:0:3282:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788970255.304817:0:3282:0:(import.c:65:import_set_state_nolock()) ffff977878834000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970255.304831:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970255.304836:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875870741557120:0@lo:8:kworker.0 00000004:00080000:1.0:1788970255.304879:0:18950:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1788970255.304894:0:18950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18950:1875870741557760:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788970255.304918:0:18950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.304934:0:18950:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37c00 going to sleep for 11 seconds 00010000:00080000:1.0:1788970255.304952:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880e903c0 x1875870741557376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.304963:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741557376:0@lo:400:kworker.0 00010000:00080000:1.0:1788970255.304972:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97787ff66940 x1875870741557248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.304980:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741557248:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.304997:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741557632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970255.305034:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.305056:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741556864:0@lo:400:kworker.0 00010000:00080000:1.0:1788970255.305065:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880e92580 x1875870741557504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.305080:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741557504:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.305093:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787ff65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741556992:0@lo:400:kworker.0 00000100:00100000:1.0:1788970255.305119:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557632 00000100:00100000:1.0:1788970255.305123:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557632 00000100:00100000:1.0:1788970255.305151:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970255.305157:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741557632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970255.305180:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970255.305212:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875870741557632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.305218:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788970255.305234:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788970255.305247:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff977880e90000 x1875870741557632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970255.305261:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741557632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970255.305275:0:19609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557760 00000100:00100000:1.0:1788970255.305277:0:19609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557760 00000100:00100000:1.0:1788970255.305297:0:19609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970255.305303:0:19609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18950:x1875870741557760:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788970255.306084:0:18949:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788970255.306445:0:18949:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567269653820ns, next at 0ns, rc = 0 00002000:00080000:1.0:1788970255.310833:0:19609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788970255.310845:0:19609:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788970255.310851:0:19609:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:1.0:1788970255.339316:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.339331:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.339368:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.339373:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.339381:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.339401:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.339413:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.339422:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.339450:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970255.340090:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.340098:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340109:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.340112:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.340117:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340128:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340148:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340156:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340170:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788970255.340576:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.340582:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340590:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.340593:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.340597:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340606:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340614:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340622:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.340648:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788970255.340938:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970255.340948:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.340957:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.340966:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.340977:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.340996:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341017:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b553e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341039:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970255.341042:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341048:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.341050:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341057:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341066:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341072:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b5545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341092:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.341094:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341101:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.341104:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341110:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341119:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341126:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b554c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.341136:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.341138:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.341139:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.342268:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.350865:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.350881:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.350899:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.350904:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.350910:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.350924:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.350934:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.350941:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.350959:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970255.351492:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.351499:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351509:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.351519:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.351524:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351534:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351542:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351548:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351565:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970255.351577:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970255.351582:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351589:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.351594:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351602:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351617:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351634:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f0d69a/0x5d0de860b05b5553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351651:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.351654:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351660:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.351663:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351670:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351680:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351686:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e69f12/0x5d0de860b05b555a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.351696:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.351697:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.351699:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.352140:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.352148:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352165:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.352169:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.352173:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352184:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352193:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352201:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352219:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970255.352620:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.352627:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352635:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.352639:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.352642:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352651:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352671:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352677:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.352685:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970255.352697:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970255.352704:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352712:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.352721:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352730:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352744:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352751:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861b9cce/0x5d0de860b05b5561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352767:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.352771:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352777:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.352780:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352810:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352821:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352828:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9d5d60/0x5d0de860b05b5568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.352846:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.352848:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.352849:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.353093:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.353100:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353108:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.353111:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.353115:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353124:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353133:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353142:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353175:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970255.353552:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.353558:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353567:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.353570:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.353574:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353583:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353590:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353598:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.353607:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970255.354549:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970255.354558:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354569:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.354573:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354583:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354601:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354609:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002251d49/0x5d0de860b05b556f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354626:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.354630:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354637:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.354666:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354675:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354686:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354693:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b5576 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.354705:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.354707:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.354709:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.355617:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.363780:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.363814:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363832:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.363843:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.363850:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363864:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363874:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363882:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363906:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.363923:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.363929:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363937:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.363942:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363950:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363966:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.363986:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b557d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364019:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.364022:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.364023:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.364467:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.364474:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364483:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.364487:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.364491:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364500:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364508:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364515:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364531:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.364541:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.364551:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364558:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.364561:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364570:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364582:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364587:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b5584 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.364602:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.364604:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.364605:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.365038:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.365044:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365054:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.365058:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.365063:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365084:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365093:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365102:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365117:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.365126:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.365131:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365138:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.365142:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365151:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365163:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365171:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a204ae/0x5d0de860b05b558b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365191:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.365193:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.365195:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.365611:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.365617:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365626:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.365629:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.365634:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365644:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365652:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365659:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365676:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.365686:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.365690:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365708:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.365712:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365720:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365732:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365739:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be36b94/0x5d0de860b05b5592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.365753:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.365755:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.365756:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.376559:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.376574:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376590:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.376594:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.376600:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376614:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376631:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376638:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376657:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.376672:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.376677:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376686:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.376691:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.376701:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.379516:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.379535:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85e43c5/0x5d0de860b05b5599 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.379562:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.379582:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.379585:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970255.380488:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.380497:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.380526:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.380531:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.380538:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.380553:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.380564:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.380579:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.380592:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788970255.380948:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788970255.381039:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.381045:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381054:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.381057:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.381061:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381070:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381078:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381085:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.381085:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381093:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381101:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.381106:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381108:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.381116:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381305:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788970255.381503:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.381509:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381522:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.381526:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.381530:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381539:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381546:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381553:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381560:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970255.381561:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970255.381567:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381580:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970255.381583:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381591:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381610:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381618:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2817a5/0x5d0de860b05b55a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.381634:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.381636:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.381638:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381828:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381836:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004bce81c/0x5d0de860b05b55a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381849:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381851:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381853:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381933:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381935:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381936:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.381941:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381959:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485a00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.381962:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381970:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970255.381975:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.381980:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381981:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.381988:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c50ad1/0x5d0de860b05b55ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.381989:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.381993:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.381997:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382012:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382014:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382015:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.382018:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382037:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382044:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382063:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.382171:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.382176:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382184:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.382187:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382195:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382211:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382219:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2836134/0x5d0de860b05b55b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382231:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382233:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382235:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970255.382453:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.382458:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382467:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.382469:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.382473:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382483:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382491:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382498:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382528:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.382550:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.382555:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382563:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f484000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.382566:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382575:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382586:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382593:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51eedad/0x5d0de860b05b55bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.382616:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382618:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.382619:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970255.382913:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788970255.382919:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382927:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788970255.382930:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970255.382934:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382943:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382951:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382958:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382972:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970255.382980:0:20619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.382984:0:20619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.382991:0:20619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc16ed8b0) 00002000:00010000:1.0:1788970255.384330:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.384340:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384354:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.384358:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.384365:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384378:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384388:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384397:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384412:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.384437:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.384442:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384462:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dc600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.384466:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384476:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384491:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384499:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030f76017/0x5d0de860b05b55ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384516:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.384517:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.384519:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.384958:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.384966:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384975:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.384978:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.384983:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.384992:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385017:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385024:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385037:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.385047:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.385053:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385059:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dd000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.385062:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385070:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385082:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385089:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d4d7d9/0x5d0de860b05b55d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385102:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.385109:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.385110:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.385509:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.385516:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385524:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.385527:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.385532:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385542:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385550:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385558:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385571:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.385580:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.385584:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385591:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.385595:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385614:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385625:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385633:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f18cc98/0x5d0de860b05b55d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.385647:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.385648:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.385650:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.386080:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.386087:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386096:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.386099:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.386103:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386113:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386122:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386135:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386148:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.386157:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.386161:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386168:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.386171:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386179:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386190:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386198:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b754ed67/0x5d0de860b05b55df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386211:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.386212:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.386214:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.386574:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.386587:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386596:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.386599:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.386604:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386613:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386622:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386630:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386643:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.386651:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.386656:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386664:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.386668:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386676:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386694:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386702:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b470c427/0x5d0de860b05b55e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.386715:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.386716:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.386718:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.387346:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.387354:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.387363:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.387367:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.387371:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.387381:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.387388:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.387395:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.394277:0:20619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.394299:0:20619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.394321:0:20619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.394329:0:20619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000765eba4/0x5d0de860b05b55c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.394354:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.394356:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.394358:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.394494:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.394508:0:18913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.394514:0:18913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.394522:0:18913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.394525:0:18913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.394533:0:18913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.394545:0:18913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.394552:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007d47510/0x5d0de860b05b55ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.395893:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.395898:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.395901:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.397933:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.397947:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.397965:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.397979:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.397986:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398012:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398023:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398031:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398045:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970255.398058:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970255.398063:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398070:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970255.398074:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398082:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398099:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398117:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fac75e1/0x5d0de860b05b55f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.398137:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.398139:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970255.398140:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.405445:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.405462:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.405480:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.405485:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.405493:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.405509:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.405520:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.405528:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.405550:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970255.408490:0:18914:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970255.408503:0:18914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.408517:0:18914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970255.408522:0:18914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.408535:0:18914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.408573:0:18914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.408581:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c3c9f7/0x5d0de860b05b55fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.408607:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.408609:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.408610:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.417872:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.417894:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.417911:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.417916:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.417922:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.417937:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.417948:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.417956:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.417973:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970255.417988:0:20619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970255.417996:0:20619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.418015:0:20619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970255.418020:0:20619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.418029:0:20619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.418047:0:20619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.418060:0:20619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e77d807/0x5d0de860b05b5602 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.418077:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.418079:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970255.418081:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788970255.418523:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.418530:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.418540:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.418544:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.418548:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.418558:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.418572:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.418579:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.418605:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788970255.419027:0:19609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788970255.419032:0:19609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.419041:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788970255.419044:0:19609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970255.419048:0:19609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.419056:0:19609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.419064:0:19609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.419070:0:19609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970255.419098:0:19609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788970255.419271:0:19609:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1788970255.419363:0:19609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18950:x1875870741557760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114055us (114440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970255.419372:0:19609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970255.419429:0:18950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18950:1875870741557760:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788970255.419445:0:18950:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:1.0:1788970255.419489:0:18950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18950:1875870741557888:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788970255.419521:0:18950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970255.419560:0:18950:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970255.419578:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741557888 00000100:00100000:1.0:1788970255.419584:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741557888 00000100:00100000:1.0:1788970255.419620:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970255.419629:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18950:x1875870741557888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788970255.419664:0:19608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:3.0:1788970255.421991:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970255.422018:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422032:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789e00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970255.422037:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422048:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422070:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422078:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb0ea6e5/0x5d0de860b05b5609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422125:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970255.422130:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422136:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789000 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970255.422139:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422147:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422158:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970255.422162:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.422165:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014668925/0x5d0de860b05b5610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970255.422177:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.422179:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970255.422180:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788970255.430322:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788970255.433663:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18950:x1875870741557888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14027us (14133us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788970255.433675:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970255.433753:0:18950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18950:1875870741557888:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788970255.433769:0:18950:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:3.0:1788970256.197105:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970256.326329:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741558016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970256.326415:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970256.326526:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558016 00000100:00100000:2.0:1788970256.326536:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558016 00000100:00100000:2.0:1788970256.326588:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970256.326597:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741558016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970256.326636:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970256.326682:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875870741558016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970256.326689:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970256.326743:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741558016:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788970256.834861:0:20688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg209-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788970257.221017:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970258.245332:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970259.217994:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.221042:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129152 00000100:00100000:1.0:1788970259.221063:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129152 00000100:00100000:1.0:1788970259.221130:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1788970259.221140:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875870732129152:12345-192.168.202.9@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788970259.221180:0:18917:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ecc7d393-eb0b-4f2e-87f7-11a974cb2d16@192.168.202.9@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1788970259.221221:0:18917:0:(genops.c:1384:class_connect()) connect: client ecc7d393-eb0b-4f2e-87f7-11a974cb2d16, cookie 0x5d0de860b05b5617 00000100:00080000:1.0:1788970259.221413:0:18917:0:(import.c:65:import_set_state_nolock()) ffff97784fd71800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970259.221514:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+5:2352:x1875870732129152:12345-192.168.202.9@tcp:250:mount.lustre.0 Request processed in 373us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.221524:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 74 00000100:00100000:1.0:1788970259.239442:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.239552:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129280 00000100:00100000:2.0:1788970259.239568:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129280 00000100:00100000:2.0:1788970259.239673:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:2.0:1788970259.239685:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+5:16760:x1875870732129280:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970259.239709:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970259.239750:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030200/0x5d0de860b05b561e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee1c expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.239853:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030200/0x5d0de860b05b561e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee1c expref: 6 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.239867:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030200/0x5d0de860b05b561e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee1c expref: 6 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.239878:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030200, rc 0) 00000100:00100000:2.0:1788970259.239960:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+6:16760:x1875870732129280:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 277us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.239977:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 75 00000100:00100000:1.0:1788970259.248383:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970259.248498:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129408 00000100:00100000:3.0:1788970259.248512:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129408 00000100:00100000:3.0:1788970259.248626:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:3.0:1788970259.248645:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+6:16760:x1875870732129408:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970259.249390:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+6:16760:x1875870732129408:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 746us (1020us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970259.249400:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 76 00000100:00100000:0.0:1788970259.254482:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.254710:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129536 00000100:00100000:2.0:1788970259.254726:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129536 00000100:00100000:2.0:1788970259.254900:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:2.0:1788970259.254914:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+6:16760:x1875870732129536:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970259.254938:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970259.254973:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840030e00/0x5d0de860b05b5625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee23 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.255015:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840030e00/0x5d0de860b05b5625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee23 expref: 7 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.255028:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840030e00/0x5d0de860b05b5625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee23 expref: 7 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.255065:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030e00, rc 0) 00000100:00100000:2.0:1788970259.255144:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+7:16760:x1875870732129536:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 233us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.255151:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 77 00000100:00100000:1.0:1788970259.261368:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.261725:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129664 00000100:00100000:2.0:1788970259.261740:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129664 00000100:00100000:2.0:1788970259.261999:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:2.0:1788970259.262011:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+7:16760:x1875870732129664:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970259.262517:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16760:x1875870732129664:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 506us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.262527:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 78 00000100:00100000:3.0:1788970259.267570:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.267914:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129792 00000100:00100000:2.0:1788970259.267927:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129792 00000100:00100000:2.0:1788970259.268073:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 79 00000100:00100000:2.0:1788970259.268087:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16760:x1875870732129792:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788970259.268466:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16760:x1875870732129792:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 381us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.268476:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 79 00010000:00010000:3.0:1788970259.269385:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970259.278261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.278672:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732129920 00000100:00100000:2.0:1788970259.278686:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732129920 00000100:00100000:2.0:1788970259.278883:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:2.0:1788970259.278898:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16779:x1875870732129920:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970259.279400:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16779:x1875870732129920:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 505us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.279421:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 80 00000100:00100000:3.0:1788970259.308697:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.309059:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130048 00000100:00100000:2.0:1788970259.309086:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130048 00000100:00100000:2.0:1788970259.309171:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:2.0:1788970259.309183:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97785c040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16779:x1875870732130048:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970259.310202:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97785c040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16779:x1875870732130048:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 1013us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.310216:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 81 00000100:00100000:2.0:1788970259.321311:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.323357:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130176 00000100:00100000:1.0:1788970259.323377:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130176 00000100:00100000:1.0:1788970259.323492:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:1.0:1788970259.323507:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+8:16760:x1875870732130176:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970259.323548:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970259.323577:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977743788c00/0x5d0de860b05b562c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee4d expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.323619:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977743788c00/0x5d0de860b05b562c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee4d expref: 9 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.323635:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977743788c00/0x5d0de860b05b562c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee4d expref: 9 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.323647:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743788c00, rc 0) 00000100:00100000:1.0:1788970259.323735:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+9:16760:x1875870732130176:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 232us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.323742:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 82 00000100:00100000:0.0:1788970259.338565:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.338977:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130304 00000100:00100000:1.0:1788970259.338993:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130304 00000100:00100000:1.0:1788970259.339068:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:1.0:1788970259.339099:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+9:16760:x1875870732130304:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788970259.339142:0:18917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788970259.339166:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788970259.339171:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788970259.339174:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788970259.339176:0:18917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1788970259.343775:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+9:16760:x1875870732130304:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 4659us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.343834:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 83 00000100:00100000:0.0:1788970259.348447:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.348694:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130432 00000100:00100000:2.0:1788970259.348709:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130432 00000100:00100000:2.0:1788970259.349136:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:2.0:1788970259.349150:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+9:16760:x1875870732130432:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970259.349177:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970259.349202:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee54 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.349248:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 10 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.349263:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 10 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970259.349275:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031c00, rc 0) 00000100:00100000:2.0:1788970259.349368:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16760:x1875870732130432:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 222us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.349397:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 84 00000100:00100000:0.0:1788970259.352113:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.353258:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130560 00000100:00100000:1.0:1788970259.353276:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130560 00000100:00100000:1.0:1788970259.353350:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:1.0:1788970259.353362:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16760:x1875870732130560:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788970259.354368:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16760:x1875870732130560:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 997us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.354382:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 85 00000100:00100000:3.0:1788970259.356989:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.357185:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130688 00000100:00100000:2.0:1788970259.357198:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130688 00000100:00100000:2.0:1788970259.357307:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:2.0:1788970259.357321:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16760:x1875870732130688:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788970259.357650:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16760:x1875870732130688:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 331us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.357659:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 86 00000100:00100000:0.0:1788970259.361754:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.361956:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130816 00000100:00100000:2.0:1788970259.362001:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130816 00000100:00100000:2.0:1788970259.362097:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:2.0:1788970259.362112:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16785:x1875870732130816:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970259.362450:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16785:x1875870732130816:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 340us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.362461:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 87 00000100:00100000:0.0:1788970259.367598:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.367841:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732130944 00000100:00100000:2.0:1788970259.367854:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732130944 00000100:00100000:2.0:1788970259.367933:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:2.0:1788970259.367946:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16785:x1875870732130944:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970259.368311:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16785:x1875870732130944:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 367us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.368321:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 88 00000100:00100000:0.0:1788970259.374528:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.374648:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131072 00000100:00100000:1.0:1788970259.374663:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131072 00000100:00100000:1.0:1788970259.374738:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1788970259.374752:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875870732131072:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788970259.374846:0:18927:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3ddccf71-4790-4791-aebd-d7befc8b3aaa@192.168.202.9@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1788970259.374924:0:18927:0:(genops.c:1384:class_connect()) connect: client 3ddccf71-4790-4791-aebd-d7befc8b3aaa, cookie 0x5d0de860b05b563a 00000004:00100000:1.0:1788970259.374979:0:18927:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788970259.374989:0:18927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788970259.444975:0:18927:0:(import.c:65:import_set_state_nolock()) ffff977741dbe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970259.445098:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2352:x1875870732131072:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 70346us (70587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970259.445111:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788970259.451943:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.452060:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131328 00000100:00100000:2.0:1788970259.452070:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131328 00000100:00100000:2.0:1788970259.452203:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:2.0:1788970259.452214:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131328:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788970259.452261:0:18925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788970259.452356:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131328:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 145us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.452364:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00080000:1.0:1788970259.453067:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970259.460173:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970259.460262:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131200 00000100:00100000:3.0:1788970259.460273:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131200 00000100:00100000:3.0:1788970259.460400:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:3.0:1788970259.460411:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:0:x1875870732131200:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970259.460456:0:18926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970259.460531:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:0:x1875870732131200:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 122us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970259.460539:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:0.0:1788970259.462865:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970259.462948:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131456 00000100:00100000:3.0:1788970259.462956:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131456 00000100:00100000:3.0:1788970259.463047:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:3.0:1788970259.463058:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131456:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788970259.463146:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131456:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970259.463154:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970259.467746:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970259.467826:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970259.467878:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970259.467978:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131584 00000100:00100000:2.0:1788970259.467988:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131584 00000100:00100000:2.0:1788970259.468035:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131712 00000100:00100000:2.0:1788970259.468038:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131712 00000100:00100000:2.0:1788970259.468060:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970259.468067:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870732131584:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970259.468103:0:19611:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3ddccf71-4790-4791-aebd-d7befc8b3aaa@192.168.202.9@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1788970259.468133:0:19611:0:(genops.c:1384:class_connect()) connect: client 3ddccf71-4790-4791-aebd-d7befc8b3aaa, cookie 0x5d0de860b05b5641 00002000:00100000:2.0:1788970259.468146:0:19611:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ddccf71-4790-4791-aebd-d7befc8b3aaa/ffff97774248d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970259.468171:0:19611:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788970259.468489:0:19611:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788970259.468524:0:19611:0:(import.c:65:import_set_state_nolock()) ffff97774248b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970259.468598:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2352:x1875870732131584:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 530us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.468606:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970259.468624:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970259.468629:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875870732131712:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788970259.468644:0:19611:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3ddccf71-4790-4791-aebd-d7befc8b3aaa@192.168.202.9@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:2.0:1788970259.468660:0:19611:0:(genops.c:1384:class_connect()) connect: client 3ddccf71-4790-4791-aebd-d7befc8b3aaa, cookie 0x5d0de860b05b5648 00002000:00100000:2.0:1788970259.468673:0:19611:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ddccf71-4790-4791-aebd-d7befc8b3aaa/ffff97774248a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788970259.468688:0:19611:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788970259.468825:0:19611:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788970259.468839:0:19611:0:(import.c:65:import_set_state_nolock()) ffff977742488800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970259.468862:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2352:x1875870732131712:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 231us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970259.468868:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1788970259.469086:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131840 00000100:00100000:3.0:1788970259.469092:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131840 00000100:00100000:3.0:1788970259.469131:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788970259.469144:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131840:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788970259.473510:0:18928:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4307us 00000004:00200000:3.0:1788970259.498684:0:18928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788970259.498840:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16760:x1875870732131840:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 29686us (30951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970259.498852:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970259.687146:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970259.687246:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732131968 00000100:00100000:1.0:1788970259.687270:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732131968 00000100:00100000:1.0:1788970259.687375:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:1.0:1788970259.687385:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:16806:x1875870732131968:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:1.0:1788970259.687406:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970259.687434:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788000/0x5d0de860b05b564f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee7e expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687502:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687516:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687542:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970259.687581:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788970259.687585:0:18927:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970259.687627:0:18927:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687653:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788000/0x5d0de860b05b564f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee7e expref: 8 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687672:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee7e expref: 7 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970259.687681:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:1.0:1788970259.687685:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970259.687688:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743788a00, rc 0) 00000100:00100000:1.0:1788970259.687754:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:16806:x1875870732131968:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 370us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970259.688106:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00010000:00010000:3.0:1788970260.293054:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970260.422426:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970260.422460:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970260.422723:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970260.422926:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558144 00000100:00100000:0.0:1788970260.422938:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558144 00000100:00100000:0.0:1788970260.423012:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970260.423022:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741558144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970260.423046:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788970260.423211:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970260.423333:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741558528:0@lo:400:kworker.0 00000100:00100000:2.0:1788970260.423375:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.423400:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970260.423406:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741558656:0@lo:400:kworker.0 00000100:00100000:2.0:1788970260.423428:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970260.423468:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558528 00000100:00100000:2.0:1788970260.423473:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558528 00000100:00100000:2.0:1788970260.423501:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558656 00000100:00100000:2.0:1788970260.423504:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558656 00000100:00100000:0.0:1788970260.423730:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875870741558144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 708us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970260.423738:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970260.423826:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875870741558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970260.423869:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741558400:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.423897:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970260.423917:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970260.423923:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741558272:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.423950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970260.423987:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741558784:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424014:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970260.424040:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558400 00000100:00100000:0.0:1788970260.424044:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558400 00000100:00100000:0.0:1788970260.424085:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970260.424092:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741558400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424144:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741558400:12345-0@lo:400:kworker.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970260.424150:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970260.424175:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741558400:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424210:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558272 00000100:00100000:0.0:1788970260.424214:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558272 00000100:00100000:0.0:1788970260.424238:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970260.424245:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3284:x1875870741558272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424277:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3284:x1875870741558272:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970260.424284:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788970260.424318:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741558272:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424340:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558784 00000100:00100000:0.0:1788970260.424343:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558784 00000100:00100000:0.0:1788970260.424363:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970260.424369:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741558528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.424402:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741558528:12345-0@lo:400:kworker.0 Request processed in 34us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970260.424409:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970260.424421:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970260.424427:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741558784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970260.426376:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970260.426390:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741558656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970260.426475:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741558656:12345-0@lo:400:kworker.0 Request processed in 88us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970260.426482:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970260.427630:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875870741558784:12345-0@lo:400:kworker.0 Request processed in 3197us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970260.427640:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970260.427695:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875870741558784:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.427745:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741558656:0@lo:400:kworker.0 00000100:00100000:0.0:1788970260.431735:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741558528:0@lo:400:kworker.0 00000100:00080000:1.0:1788970260.440502:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970260.440512:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788970260.514872:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788970260.514916:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ddccf71-4790-4791-aebd-d7befc8b3aaa 00010000:00010000:0.0:1788970261.317058:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970261.445057:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970261.445083:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741558912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970261.445165:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970261.445336:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741558912 00000100:00100000:2.0:1788970261.445345:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741558912 00000100:00100000:2.0:1788970261.445404:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970261.445415:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741558912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970261.445462:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970261.445520:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741558912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.445542:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970261.445637:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741558912:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788970261.481183:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ddccf71-4790-4791-aebd-d7befc8b3aaa 00000100:00100000:2.0:1788970261.706266:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970261.706357:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132096 00000100:00100000:3.0:1788970261.706369:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132096 00000100:00100000:3.0:1788970261.706458:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:3.0:1788970261.706470:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:16858:x1875870732132096:12345-192.168.202.9@tcp:41:lfs.0 00000004:00000024:3.0:1788970261.706517:0:18926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970261.706610:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:16858:x1875870732132096:12345-192.168.202.9@tcp:41:lfs.0 Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970261.706618:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00080000:1.0:1788970261.707225:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970261.714920:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.715042:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132224 00000100:00100000:2.0:1788970261.715053:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132224 00000100:00100000:2.0:1788970261.715136:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970261.715147:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:16858:x1875870732132224:12345-192.168.202.9@tcp:13:lfs.0 00002000:00000024:2.0:1788970261.715173:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970261.715263:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:16858:x1875870732132224:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 117us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.715270:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00080000:1.0:1788970261.716036:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970261.726476:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.726583:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132352 00000100:00100000:2.0:1788970261.726594:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132352 00000100:00100000:2.0:1788970261.726713:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788970261.726724:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:16858:x1875870732132352:12345-192.168.202.9@tcp:13:lfs.0 00002000:00000024:2.0:1788970261.726770:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970261.726882:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:16858:x1875870732132352:12345-192.168.202.9@tcp:13:lfs.0 Request processed in 160us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.726889:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:1.0:1788970261.727349:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970261.888021:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970261.888126:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132480 00000100:00100000:1.0:1788970261.888138:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132480 00000100:00100000:1.0:1788970261.888197:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:1.0:1788970261.888206:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+10:16889:x1875870732132480:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970261.888222:0:18917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970261.888240:0:18917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977743788000/0x5d0de860b05b565d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ee85 expref: -99 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970261.888269:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977743788000/0x5d0de860b05b565d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee85 expref: 11 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970261.888280:0:18917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977743788000/0x5d0de860b05b565d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee85 expref: 11 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970261.888289:0:18917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743788000, rc 0) 00000100:00100000:1.0:1788970261.888390:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732132480:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970261.888397:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 90 00000100:00100000:0.0:1788970261.897907:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.898018:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132608 00000100:00100000:2.0:1788970261.898030:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132608 00000100:00100000:2.0:1788970261.898090:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:2.0:1788970261.898101:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732132608:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970261.898455:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732132608:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 354us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.898463:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 91 00000100:00100000:2.0:1788970261.905896:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970261.906004:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132736 00000100:00100000:0.0:1788970261.906017:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132736 00000100:00100000:0.0:1788970261.906077:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:0.0:1788970261.906087:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732132736:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970261.906404:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732132736:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 317us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970261.906411:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 92 00000100:00100000:0.0:1788970261.921894:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970261.922469:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132864 00000100:00100000:1.0:1788970261.922480:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132864 00000100:00100000:1.0:1788970261.922548:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:1.0:1788970261.922559:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16895:x1875870732132864:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970261.922982:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16895:x1875870732132864:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 424us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970261.922991:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 93 00000100:00100000:1.0:1788970261.939638:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.939728:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732132992 00000100:00100000:2.0:1788970261.939738:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732132992 00000100:00100000:2.0:1788970261.939817:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:2.0:1788970261.939827:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16895:x1875870732132992:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970261.940123:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16895:x1875870732132992:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 297us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.940131:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 94 00000100:00100000:3.0:1788970261.947907:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970261.948234:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133120 00000100:00100000:0.0:1788970261.948245:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133120 00000100:00100000:0.0:1788970261.948308:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:0.0:1788970261.948319:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778735ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16889:x1875870732133120:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788970261.948338:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970261.948358:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93e00/0x5d0de860b05b5664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eeaf expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970261.948390:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93e00/0x5d0de860b05b5664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeaf expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970261.948421:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93e00/0x5d0de860b05b5664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeaf expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970261.948431:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93e00, rc 0) 00000100:00100000:0.0:1788970261.948503:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778735ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16889:x1875870732133120:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 185us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970261.948571:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 95 00000100:00100000:0.0:1788970261.958639:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970261.958816:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133248 00000100:00100000:1.0:1788970261.958827:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133248 00000100:00100000:1.0:1788970261.958884:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:1.0:1788970261.958894:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16889:x1875870732133248:12345-192.168.202.9@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788970261.958922:0:18917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788970261.958956:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788970261.958961:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788970261.958964:0:18917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788970261.958966:0:18917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788970261.961821:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16889:x1875870732133248:12345-192.168.202.9@tcp:256:mount.lustre.0 Request processed in 2888us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.961837:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 96 00000100:00100000:3.0:1788970261.970675:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.970880:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133376 00000100:00100000:2.0:1788970261.970892:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133376 00000100:00100000:2.0:1788970261.970959:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:2.0:1788970261.970969:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16889:x1875870732133376:12345-192.168.202.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970261.970988:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970261.971005:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eeb6 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970261.971037:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 13 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970261.971048:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 13 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970261.971055:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031a00, rc 0) 00000100:00100000:2.0:1788970261.971119:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16889:x1875870732133376:12345-192.168.202.9@tcp:101:mount.lustre.0 Request processed in 152us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.971141:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 97 00000100:00100000:0.0:1788970261.979323:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.979550:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133504 00000100:00100000:2.0:1788970261.979561:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133504 00000100:00100000:2.0:1788970261.979618:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:2.0:1788970261.979627:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16889:x1875870732133504:12345-192.168.202.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970261.979935:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16889:x1875870732133504:12345-192.168.202.9@tcp:501:mount.lustre.0 Request processed in 309us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.979952:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 98 00000100:00100000:1.0:1788970261.983177:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970261.983280:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133632 00000100:00100000:0.0:1788970261.983291:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133632 00000100:00100000:0.0:1788970261.983352:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:0.0:1788970261.983363:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778652ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16889:x1875870732133632:12345-192.168.202.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970261.983715:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778652ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16889:x1875870732133632:12345-192.168.202.9@tcp:503:mount.lustre.0 Request processed in 353us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970261.983724:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 99 00000100:00100000:3.0:1788970261.989175:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970261.989715:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133760 00000100:00100000:0.0:1788970261.989727:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133760 00000100:00100000:0.0:1788970261.989786:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:0.0:1788970261.989833:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16901:x1875870732133760:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788970261.991330:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16901:x1875870732133760:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 1498us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970261.991342:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 100 00000100:00100000:1.0:1788970261.994081:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970261.994195:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732133888 00000100:00100000:2.0:1788970261.994205:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732133888 00000100:00100000:2.0:1788970261.994316:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:2.0:1788970261.994326:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16901:x1875870732133888:12345-192.168.202.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970261.994720:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16901:x1875870732133888:12345-192.168.202.9@tcp:502:llog_process_th.0 Request processed in 395us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970261.994729:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 101 00000100:00100000:3.0:1788970261.997256:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970261.997321:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134016 00000100:00100000:3.0:1788970261.997330:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134016 00000100:00100000:3.0:1788970261.997372:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1788970261.997380:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875870732134016:12345-192.168.202.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788970261.997408:0:20340:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from db5b73a2-3d43-4c86-aa18-b7a82e944807@192.168.202.9@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1788970261.997466:0:20340:0:(genops.c:1384:class_connect()) connect: client db5b73a2-3d43-4c86-aa18-b7a82e944807, cookie 0x5d0de860b05b5672 00000004:00100000:3.0:1788970261.997497:0:20340:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788970261.997625:0:20340:0:(import.c:65:import_set_state_nolock()) ffff977741dba000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970261.997689:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2352:x1875870732134016:12345-192.168.202.9@tcp:38:mount.lustre.0 Request processed in 308us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970261.997697:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:3.0:1788970262.006539:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970262.006643:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970262.012528:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134144 00000100:00100000:0.0:1788970262.012545:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134144 00000100:00100000:3.0:1788970262.013653:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134272 00000100:00100000:3.0:1788970262.013661:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134272 00000100:00100000:3.0:1788970262.013705:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970262.013716:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+7:0:x1875870732134144:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970262.013752:0:20340:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970262.013852:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+7:0:x1875870732134144:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 138us (7584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.013860:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970262.013880:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788970262.013887:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134272:12345-192.168.202.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788970262.013900:0:20340:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788970262.013922:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134272:12345-192.168.202.9@tcp:41:mount.lustre.0 Request processed in 36us (7279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.013929:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:0.0:1788970262.022263:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970262.022405:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134400 00000100:00100000:3.0:1788970262.022418:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134400 00000100:00100000:3.0:1788970262.022492:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1788970262.022504:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134400:12345-192.168.202.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788970262.022607:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134400:12345-192.168.202.9@tcp:40:mount.lustre.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.022615:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00080000:1.0:1788970262.023330:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970262.025122:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970262.025177:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970262.025453:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134528 00000100:00100000:0.0:1788970262.025463:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134528 00000100:00100000:0.0:1788970262.025676:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134656 00000100:00100000:0.0:1788970262.025680:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134656 00000100:00100000:0.0:1788970262.025787:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788970262.025818:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875870732134528:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788970262.025851:0:19608:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from db5b73a2-3d43-4c86-aa18-b7a82e944807@192.168.202.9@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1788970262.025882:0:19608:0:(genops.c:1384:class_connect()) connect: client db5b73a2-3d43-4c86-aa18-b7a82e944807, cookie 0x5d0de860b05b5679 00002000:00100000:0.0:1788970262.025895:0:19608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db5b73a2-3d43-4c86-aa18-b7a82e944807/ffff977741a85000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970262.025906:0:19608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788970262.026254:0:19608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970262.026290:0:19608:0:(import.c:65:import_set_state_nolock()) ffff977741a82000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970262.026361:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2352:x1875870732134528:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 544us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970262.026370:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788970262.026388:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970262.026393:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875870732134656:12345-192.168.202.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788970262.026413:0:19608:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from db5b73a2-3d43-4c86-aa18-b7a82e944807@192.168.202.9@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1788970262.026429:0:19608:0:(genops.c:1384:class_connect()) connect: client db5b73a2-3d43-4c86-aa18-b7a82e944807, cookie 0x5d0de860b05b5680 00002000:00100000:0.0:1788970262.026434:0:19608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db5b73a2-3d43-4c86-aa18-b7a82e944807/ffff977741a84800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970262.026446:0:19608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788970262.026589:0:19608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788970262.026606:0:19608:0:(import.c:65:import_set_state_nolock()) ffff977741a87000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970262.026631:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2352:x1875870732134656:12345-192.168.202.9@tcp:8:mount.lustre.0 Request processed in 236us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970262.026653:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970262.034390:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970262.034547:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134784 00000100:00100000:1.0:1788970262.034557:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134784 00000100:00100000:1.0:1788970262.034619:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:1.0:1788970262.034629:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134784:12345-192.168.202.9@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788970262.034724:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788970262.034836:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16889:x1875870732134784:12345-192.168.202.9@tcp:33:mount.lustre.0 Request processed in 209us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970262.034844:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788970262.249130:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970262.249378:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732134912 00000100:00100000:3.0:1788970262.249390:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732134912 00000100:00100000:3.0:1788970262.249451:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:3.0:1788970262.249460:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:16924:x1875870732134912:12345-192.168.202.9@tcp:101:mkdir.0 00010000:00010000:3.0:1788970262.249567:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970262.249590:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eee0 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249651:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249664:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249676:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970262.249710:0:18926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970262.249713:0:18926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970262.249731:0:18926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249755:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 8 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249832:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 7 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970262.249840:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:3.0:1788970262.249844:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970262.249848:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:3.0:1788970262.250457:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+7:16924:x1875870732134912:12345-192.168.202.9@tcp:101:mkdir.0 Request processed in 995us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970262.250466:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:0.0:1788970262.342011:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970262.917826:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970263.369639:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970264.391662:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788970264.590896:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db5b73a2-3d43-4c86-aa18-b7a82e944807 00000001:00100000:0.0:1788970264.590924:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ddccf71-4790-4791-aebd-d7befc8b3aaa 00000001:02000400:1.0:1788970265.224057:0:20892:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788970265.412987:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970265.541144:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970265.541180:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741559040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970265.541316:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970265.545062:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741559296:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.545133:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741559424:0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.545163:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970265.545169:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.545271:0:19612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559040 00000100:00100000:3.0:1788970265.545283:0:19612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559040 00000100:00100000:3.0:1788970265.545369:0:19612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970265.545384:0:19612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741559040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788970265.545443:0:19612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788970265.545511:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741559552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.546893:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559296 00000100:00100000:0.0:1788970265.546915:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559296 00000100:00100000:0.0:1788970265.546976:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970265.546986:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741559296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.547066:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741559296:12345-0@lo:400:kworker.0 Request processed in 81us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.547073:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970265.547105:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559424 00000100:00100000:0.0:1788970265.547110:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559424 00000100:00100000:0.0:1788970265.547141:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970265.547147:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741559424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.547184:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875870741559424:12345-0@lo:400:kworker.0 Request processed in 37us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970265.547191:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970265.548036:0:19612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741559040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2651us (6714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.548050:0:19612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970265.548127:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741559168:0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.548179:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.548626:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970265.548697:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559552 00000100:00100000:2.0:1788970265.548704:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559552 00000100:00100000:2.0:1788970265.548751:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970265.548760:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.548774:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741559680:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.548838:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741559552:12345-0@lo:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970265.548846:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970265.548921:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970265.548966:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788970265.549000:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741559040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970265.549043:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559680 00000100:00100000:3.0:1788970265.549047:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559680 00000100:00100000:3.0:1788970265.549072:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970265.549078:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741559680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970265.549116:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875870741559680:12345-0@lo:400:kworker.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970265.549122:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970265.549148:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875870741559680:0@lo:400:kworker.0 00000100:00100000:2.0:1788970265.549161:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741559552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.549649:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559168 00000100:00100000:0.0:1788970265.549655:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559168 00000100:00100000:0.0:1788970265.549777:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970265.550661:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3286:x1875870741559168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.552098:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:3286:x1875870741559168:12345-0@lo:400:kworker.0 Request processed in 1441us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970265.552503:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741559296:0@lo:400:kworker.0 00000100:00080000:1.0:1788970265.552553:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970265.552562:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970265.552566:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970265.552729:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875870741559424:0@lo:400:kworker.0 00000100:00100000:1.0:1788970265.552778:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3286:1875870741559168:0@lo:400:kworker.0 00000100:00100000:0.0:1788970265.558979:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000001:00100000:1.0:1788970265.624596:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db5b73a2-3d43-4c86-aa18-b7a82e944807 00010000:00010000:2.0:1788970266.438470:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970266.566713:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741559808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970266.566843:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970266.567336:0:19612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741559808 00000100:00100000:3.0:1788970266.567349:0:19612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741559808 00000100:00100000:3.0:1788970266.567427:0:19612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970266.567439:0:19612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741559808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970266.568171:0:19612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788970266.568266:0:19612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741559808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 828us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970266.568275:0:19612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970266.569759:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741559808:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788970266.669039:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db5b73a2-3d43-4c86-aa18-b7a82e944807 00000100:00100000:0.0:1788970267.197105:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.197161:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.197191:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.197217:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.197256:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135168 00000100:00100000:0.0:1788970267.197270:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135168 00000100:00100000:0.0:1788970267.197360:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788970267.197374:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2353:x1875870732135168:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:0.0:1788970267.197489:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2353:x1875870732135168:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970267.197498:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1788970267.197678:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135040 00000100:00100000:2.0:1788970267.197683:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135040 00000100:00100000:2.0:1788970267.197719:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1788970267.197728:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:2354:x1875870732135040:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970267.197760:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:2354:x1875870732135040:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970267.197766:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 103 00000100:00100000:2.0:1788970267.197818:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135424 00000100:00100000:2.0:1788970267.197821:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135424 00000100:00100000:2.0:1788970267.197850:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135680 00000100:00100000:2.0:1788970267.197852:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135680 00000100:00100000:2.0:1788970267.197874:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1788970267.197881:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2353:x1875870732135424:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970267.197920:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2353:x1875870732135424:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970267.197926:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:2.0:1788970267.197937:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:2.0:1788970267.197942:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2353:x1875870732135680:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970267.197976:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2353:x1875870732135680:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970267.197982:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00080000:1.0:1788970267.199924:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970267.199935:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970267.199940:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970267.204247:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.204336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970267.204377:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970267.204529:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135296 00000100:00100000:1.0:1788970267.204554:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135296 00000100:00100000:1.0:1788970267.204636:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135808 00000100:00100000:1.0:1788970267.204640:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135808 00000100:00100000:1.0:1788970267.204672:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1788970267.204684:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2354:x1875870732135296:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970267.204777:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2354:x1875870732135296:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 95us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970267.204787:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:1.0:1788970267.204836:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:1.0:1788970267.204843:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2354:x1875870732135808:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970267.204870:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2354:x1875870732135808:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970267.204876:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00080000:1.0:1788970267.204909:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970267.204914:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970267.209064:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135552 00000100:00100000:3.0:1788970267.209085:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135552 00000100:00100000:3.0:1788970267.212933:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:3.0:1788970267.212955:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2354:x1875870732135552:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970267.213074:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977877fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2354:x1875870732135552:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 126us (8736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970267.213083:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00080000:1.0:1788970267.223105:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788970267.461004:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970268.487972:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788970269.316142:0:21045:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc414631c0 20000000:00000080:2.0:1788970269.316176:0:21045:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9777436db800 uarg=0000000000000000 20000000:01000000:2.0:1788970269.316230:0:21045:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970269.316238:0:21045:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788970269.316244:0:21045:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788970269.324359:0:21046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788970269.324617:0:21045:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788970269.346471:0:21045:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788970269.348383:0:21045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348466:0:21045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b534d expref: 18 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348475:0:21045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b539a expref: 18 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348504:0:21045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 18 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348515:0:21045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348523:0:21045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348532:0:21045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348598:0:21045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.348618:0:21045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.348709:0:21045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fc8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741559936:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970269.349075:0:21045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.349086:0:21045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 12 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.349095:0:21045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fc83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560064:192.168.202.9@tcp:104: 00010000:00010000:0.0:1788970269.349131:0:21045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 18 pid: 18917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.349157:0:21045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 18 pid: 18917 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.349170:0:21045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560192:0@lo:104: 00000100:00100000:0.0:1788970269.349236:0:21045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970269.349359:0:21045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 18 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.349369:0:21045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 18 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.349378:0:21045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560320:0@lo:104: 00000100:00100000:0.0:1788970269.349464:0:21045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788970269.349499:0:21045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 18 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970269.349508:0:21045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 18 pid: 18919 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.349516:0:21045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560448:0@lo:104: 00000100:00100000:0.0:1788970269.349542:0:21045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970269.349552:0:21045:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970269.349648:0:18908:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788970269.349666:0:18908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560192 00000100:00100000:2.0:1788970269.349675:0:18908:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560192 00000100:00100000:2.0:1788970269.349730:0:18908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560320 00000100:00100000:2.0:1788970269.349733:0:18908:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560320 00000100:00100000:2.0:1788970269.349745:0:18908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560448 00000100:00100000:2.0:1788970269.349747:0:18908:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560448 00000100:00100000:2.0:1788970269.349763:0:18908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970269.349774:0:18908:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:21045:x1875870741560192:12345-0@lo:104: 00010000:00010000:2.0:1788970269.349820:0:18908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.349905:0:18908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970269.349912:0:18908:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+5:21045:x1875870741560192:12345-0@lo:104: Request processed in 141us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.349919:0:18908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970269.349940:0:18908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970269.349945:0:18908:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+4:21045:x1875870741560320:12345-0@lo:104: 00010000:00010000:2.0:1788970269.349954:0:18908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.349990:0:18908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788970269.349995:0:18908:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+4:21045:x1875870741560320:12345-0@lo:104: Request processed in 50us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.350011:0:18908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970269.350024:0:18908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970269.350030:0:18908:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784effc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:21045:x1875870741560448:12345-0@lo:104: 00010000:00010000:2.0:1788970269.350036:0:18908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350072:0:18908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788970269.350076:0:18908:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784effc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+3:21045:x1875870741560448:12345-0@lo:104: Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.350081:0:18908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788970269.350140:0:20619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788970269.350148:0:20619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350155:0:20619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485600 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970269.350160:0:20619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350168:0:20619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970269.350175:0:20619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970269.350182:0:20619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970269.350224:0:20619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350231:0:20619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970269.350263:0:20619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350490:0:20619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f485600/0x5d0de860b05b54f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b54f8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350506:0:20619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970269.350509:0:20619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350514:0:20619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9778821dde00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970269.350517:0:20619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350523:0:20619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970269.350529:0:20619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970269.350534:0:20619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970269.350549:0:20619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350554:0:20619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970269.350571:0:20619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350578:0:20619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff9778821dde00/0x5d0de860b05b539a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b53a1 expref: -99 pid: 19607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350597:0:20619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970269.350600:0:20619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350607:0:20619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97787f485c00 already unused, calling callback (ffffffffc1cf3c20) 10000000:00010000:2.0:1788970269.350610:0:20619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350616:0:20619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970269.350622:0:20619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970269.350627:0:20619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788970269.350698:0:20619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350704:0:20619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970269.350711:0:20619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350718:0:20619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.109@tcp lock: ffff97787f485c00/0x5d0de860b05b534d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d0de860b05b5354 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.350733:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970269.350735:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970269.350737:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970269.350745:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970269.350757:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970269.350783:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741560576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970269.350857:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970269.350912:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741560704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970269.350937:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970269.350956:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970269.350962:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741560832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970269.350985:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970269.351020:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560576 00000100:00100000:2.0:1788970269.351027:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560576 00010000:00010000:2.0:1788970269.351056:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 19 pid: 18917 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970269.351081:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560704 00000100:00100000:2.0:1788970269.351084:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560704 00010000:00010000:2.0:1788970269.351096:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 20 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970269.351106:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560832 00000100:00100000:2.0:1788970269.351109:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560832 00010000:00010000:2.0:1788970269.351119:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 21 pid: 18919 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970269.351131:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970269.351137:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+21:3284:x1875870741560576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970269.351150:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970269.351156:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 21 pid: 18917 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.351178:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 21 pid: 18917 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.351198:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970269.351230:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+21:3284:x1875870741560576:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.351238:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970269.351254:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970269.351260:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+20:3285:x1875870741560704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970269.351268:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970269.351861:0:21045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f93600/0x5d0de860b05b54f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b54f1 expref: 20 pid: 18917 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970269.351888:0:21045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fcb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560192:0@lo:104: 00000100:00100000:0.0:1788970269.351901:0:21045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560320:0@lo:104: 00000100:00100000:0.0:1788970269.351911:0:21045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560448:0@lo:104: 00010000:00010000:2.0:1788970269.352553:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 20 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352567:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 19 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352580:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840031400/0x5d0de860b05b53a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b539a expref: 19 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352592:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970269.352889:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:3285:x1875870741560704:12345-0@lo:103:ldlm_bl.0 Request processed in 1628us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.352899:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970269.352933:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970269.352941:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851fab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:3285:x1875870741560832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970269.352955:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970269.352959:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 17 pid: 18919 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352974:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 17 pid: 18919 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352981:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97787f485200/0x5d0de860b05b5354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d0de860b05b534d expref: 17 pid: 18919 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.352989:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970269.353007:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851fab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:3285:x1875870741560832:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.353012:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970269.353093:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3284:1875870741560576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970269.353258:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741560832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970269.353267:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:629abde5-c42a-46d1-8386-6aff8bcfd1f0:3285:1875870741560704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970269.360619:0:21045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fc8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741559936:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970269.360660:0:21045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977877fc83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21045:1875870741560064:192.168.202.9@tcp:104: 00010000:00010000:1.0:1788970269.360721:0:21045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970269.362575:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970269.362623:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970269.362743:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136064 00000100:00100000:2.0:1788970269.362756:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136064 00010000:00010000:2.0:1788970269.362856:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 13 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970269.362903:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732135936 00000100:00100000:2.0:1788970269.362906:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732135936 00010000:00010000:2.0:1788970269.362919:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 14 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970269.362951:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788970269.362964:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+14:2354:x1875870732136064:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970269.362987:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970269.362995:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 14 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363010:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 14 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363060:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840031c00/0x5d0de860b05b5633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee54 expref: 14 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363083:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970269.363157:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:2354:x1875870732136064:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 194us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.363163:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788970269.363180:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970269.363184:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:2354:x1875870732135936:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970269.363190:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970269.363193:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363202:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363209:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977840031a00/0x5d0de860b05b566b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeb6 expref: 12 pid: 18920 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363218:0:19359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363226:0:19359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363240:0:19359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363253:0:19359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363259:0:19359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363264:0:19359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363267:0:19359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970269.363271:0:19359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363278:0:19359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363287:0:19359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970269.363295:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970269.363309:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:2354:x1875870732135936:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 125us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970269.363315:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00010000:00010000:1.0:1788970269.364008:0:21045:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970269.364022:0:21045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970269.364042:0:21045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff977880f93200/0x5d0de860b05b5695 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970269.509615:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970270.534349:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788970270.596931:0:18922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970270.596941:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787ea5a000 from 10 10000000:01000000:2.0:1788970270.596947:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970270.597014:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.597051:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.597064:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970270.597097:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741560960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970270.597185:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.597261:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784c274240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970270.597841:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741560960 00000100:00100000:0.0:1788970270.597851:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741560960 00000100:00100000:0.0:1788970270.597925:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788970270.597936:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+16:18922:x1875870741560960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970270.597964:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970270.597986:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f92400/0x5d0de860b05b56a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b569c expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.598013:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f92400/0x5d0de860b05b56a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b569c expref: 17 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.598024:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f92400/0x5d0de860b05b56a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b569c expref: 17 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.598032:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92400, rc 0) 00000100:00100000:0.0:1788970270.598095:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741560960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.598102:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788970270.598209:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741560960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970270.598241:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56a3 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.598254:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b56a3 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970270.598367:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.598427:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.598485:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970270.598544:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561088 00000100:00100000:2.0:1788970270.598552:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561088 00000100:00100000:2.0:1788970270.598590:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788970270.598597:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741561088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970270.598915:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741561088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.598924:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788970270.599386:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.599438:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.599988:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.600037:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970270.600095:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561216 00000100:00100000:2.0:1788970270.600107:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561216 00000100:00100000:2.0:1788970270.600168:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788970270.600176:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741561216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970270.600388:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741561216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.600395:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970270.601045:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788970270.602284:0:21058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788970270.602959:0:18922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788970270.603010:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970270.603027:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56a3 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.603042:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977840031c00/0x5d0de860b05b569c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56a3 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970270.603080:0:18922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970270.603083:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787f51c000 from 10 10000000:01000000:1.0:1788970270.603086:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970270.603143:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.603152:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.603166:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970270.603197:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.603290:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.603355:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970270.603619:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561344 00000100:00100000:0.0:1788970270.603633:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561344 00000100:00100000:0.0:1788970270.603698:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788970270.603707:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+17:18922:x1875870741561344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970270.603726:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970270.603744:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93600/0x5d0de860b05b56b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b56aa expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.603838:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93600/0x5d0de860b05b56b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b56aa expref: 18 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.603852:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93600/0x5d0de860b05b56b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b56aa expref: 18 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.603870:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93600, rc 0) 00000100:00100000:0.0:1788970270.603957:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.603972:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788970270.604158:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970270.604179:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56b1 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.604190:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b56b1 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970270.604275:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.604311:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.604366:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970270.604775:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561472 00000100:00100000:0.0:1788970270.604782:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561472 00000100:00100000:0.0:1788970270.604843:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788970270.604851:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970270.607807:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2934us (3472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.607820:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788970270.608701:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.608756:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.608877:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.608907:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970270.609837:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561600 00000100:00100000:0.0:1788970270.609849:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561600 00000100:00100000:0.0:1788970270.609913:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788970270.609923:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970270.610174:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.610181:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788970270.611413:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970270.632171:0:21059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788970270.638722:0:18922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788970270.638784:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970270.638968:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56b1 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.638983:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977743789200/0x5d0de860b05b56aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56b1 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970270.639098:0:18922:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970270.639101:0:18922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97787ef4d000 from 10 10000000:01000000:1.0:1788970270.639104:0:18922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970270.639143:0:18922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.639151:0:18922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970270.639163:0:18922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970270.639187:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.639267:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970270.639313:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977851f1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970270.639385:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561728 00000100:00100000:0.0:1788970270.639393:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561728 00000100:00100000:0.0:1788970270.639477:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788970270.639487:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+18:18922:x1875870741561728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970270.639501:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970270.639514:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977880f93200/0x5d0de860b05b56bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d0de860b05b56b8 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.639538:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977880f93200/0x5d0de860b05b56bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d0de860b05b56b8 expref: 19 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.639550:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977880f93200/0x5d0de860b05b56bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d0de860b05b56b8 expref: 19 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.639558:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f93200, rc 0) 00000100:00100000:0.0:1788970270.639608:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741561728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.639614:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970270.640343:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970270.640373:0:18922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56bf expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.640384:0:18922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d0de860b05b56bf expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970270.640614:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970270.640651:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970270.640690:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970270.640748:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561856 00000100:00100000:1.0:1788970270.640754:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561856 00000100:00100000:1.0:1788970270.640807:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788970270.640816:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741561856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.641084:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741561856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.641090:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788970270.641229:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970270.641257:0:18922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970270.641292:0:18922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970270.641317:0:18922:0:(client.c:2716:ptlrpc_set_wait()) set ffff977742c70000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970270.641596:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741561984 00000100:00100000:1.0:1788970270.641601:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741561984 00000100:00100000:1.0:1788970270.641642:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788970270.641649:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741561984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970270.641817:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:629abde5-c42a-46d1-8386-6aff8bcfd1f0+19:18922:x1875870741561984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.641824:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788970270.642213:0:18922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97784eb8f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:629abde5-c42a-46d1-8386-6aff8bcfd1f0:18922:1875870741561984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970270.644635:0:21060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788970270.645177:0:18922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788970270.645212:0:18922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970270.645223:0:18922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56bf expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.645253:0:18922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.109@tcp lock: ffff977743789400/0x5d0de860b05b56b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d0de860b05b56bf expref: -99 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970270.661121:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970270.661145:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741562112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970270.661232:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970270.661282:0:19613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741562112 00000100:00100000:0.0:1788970270.661290:0:19613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741562112 00000100:00100000:0.0:1788970270.661348:0:19613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970270.661372:0:19613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741562112:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788970270.661618:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788970270.661777:0:19613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788970270.661992:0:19613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741562112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 635us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970270.662000:0:19613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788970270.662094:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741562112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970270.662817:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741562368:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.662870:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.662915:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970270.662922:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741562496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.662945:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.662987:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741562368 00000100:00100000:2.0:1788970270.662994:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741562368 00000100:00100000:2.0:1788970270.663031:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741562496 00000100:00100000:2.0:1788970270.663034:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741562496 00000100:00100000:2.0:1788970270.663061:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970270.663069:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741562368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663111:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875870741562368:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.663118:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970270.663132:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970270.663139:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741562496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663163:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875870741562496:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.663169:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788970270.663189:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970270.663202:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741562624:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663230:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.663247:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970270.663252:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663273:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970270.663310:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875870741562496:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663320:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875870741562368:0@lo:400:kworker.0 00000100:00100000:2.0:1788970270.663347:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741562624 00000100:00100000:2.0:1788970270.663357:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741562624 00000100:00100000:2.0:1788970270.663387:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788970270.663393:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741562624:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788970270.663566:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970270.666135:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741562240 00000100:00100000:1.0:1788970270.666150:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741562240 00000100:00080000:0.0:1788970270.667301:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970270.667514:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875870741562624:0@lo:400:kworker.0 00000100:00100000:1.0:1788970270.669451:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970270.669475:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741562240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970270.669584:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875870741562240:12345-0@lo:400:kworker.0 Request processed in 123us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970270.669591:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788970270.670081:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875870741562624:12345-0@lo:400:kworker.0 Request processed in 6683us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.670093:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788970270.670301:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778812e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875870741562240:0@lo:400:kworker.0 00000100:00100000:0.0:1788970270.891275:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970270.891674:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136192 00000100:00100000:2.0:1788970270.891685:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136192 00000100:00100000:2.0:1788970270.891770:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:2.0:1788970270.891780:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:17385:x1875870732136192:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970270.891830:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970270.891863:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b56c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eee7 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.891934:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.892090:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.892109:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.892126:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.892133:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.892138:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893198:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b56db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893213:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b56db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893222:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b56db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970270.893250:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788970270.893255:0:18925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788970270.893295:0:18925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b56db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893307:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893314:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893320:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893326:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970270.893332:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893339:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893351:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:2.0:1788970270.893815:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970270.893822:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893829:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b56cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893843:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893849:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893865:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893871:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970270.893873:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893879:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893888:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff977851ac1400) 00010000:00010000:2.0:1788970270.893891:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970270.893894:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893899:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b56d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.893942:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b56c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee7 expref: 8 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788970270.894086:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788970270.894456:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030c00/0x5d0de860b05b56db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee7 expref: 7 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.894464:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:2.0:1788970270.894467:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970270.894470:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030c00, rc 0) 00000100:00100000:2.0:1788970270.894552:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:17385:x1875870732136192:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 2771us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.894562:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:0.0:1788970270.904059:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970270.908720:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136448 00000100:00100000:3.0:1788970270.908735:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136448 00000100:00100000:3.0:1788970270.908846:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788970270.908871:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:17385:x1875870732136448:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970270.908893:0:20340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970270.908914:0:20340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b56e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eeee expref: -99 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.908996:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909010:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909021:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909035:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909060:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909067:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909562:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b56f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909574:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b56f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909581:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b56f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970270.909591:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788970270.909818:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909827:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909834:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909840:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970270.909844:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909851:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909885:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff977851ac1200) 00010000:00010000:3.0:1788970270.909888:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970270.909893:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909900:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b56e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909913:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909919:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909929:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909934:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970270.909937:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909943:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909950:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff977850e18900) 00010000:00010000:3.0:1788970270.909953:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970270.909955:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.909961:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b56f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.914021:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b56e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeee expref: 10 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.914049:0:20340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5000/0x5d0de860b05b56f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eeee expref: 9 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.914059:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff977850e18800) 00010000:00010000:3.0:1788970270.914062:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970270.914065:0:20340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5000, rc 0) 00000100:00100000:3.0:1788970270.914140:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17385:x1875870732136448:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 5283us (10091us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788970270.914149:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:3.0:1788970270.922568:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970270.922889:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136576 00000100:00100000:2.0:1788970270.922903:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136576 00000100:00100000:2.0:1788970270.922979:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:2.0:1788970270.922991:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17385:x1875870732136576:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788970270.923106:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17385:x1875870732136576:12345-192.168.202.9@tcp:59:lhsmtool_posix.0 Request processed in 118us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.923113:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788970270.943977:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970270.944139:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136704 00000100:00100000:2.0:1788970270.944149:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136704 00000100:00100000:2.0:1788970270.944209:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970270.944222:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17391:x1875870732136704:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:2.0:1788970270.944243:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970270.944272:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eef5 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944348:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944377:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944391:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944407:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944414:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.944420:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945052:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945062:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945069:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945075:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970270.945079:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945086:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945099:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:2.0:1788970270.945109:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970270.945115:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945122:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b570c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945136:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945142:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945147:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945151:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970270.945154:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945160:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945167:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff977851ac1400) 00010000:00010000:2.0:1788970270.945169:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970270.945172:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945177:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5713 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945212:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5705 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eef5 expref: 10 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945229:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:2.0:1788970270.945231:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970270.945235:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eef5 expref: 10 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.945245:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788970270.945724:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17391:x1875870732136704:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 1504us (1770us total) trans 0 rc 301/301 00000100:00100000:2.0:1788970270.945733:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:0.0:1788970270.950692:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970270.950930:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732136832 00000100:00100000:2.0:1788970270.950940:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732136832 00000100:00100000:2.0:1788970270.951041:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:2.0:1788970270.951053:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17391:x1875870732136832:12345-192.168.202.9@tcp:700:lfs.0 00000100:00100000:2.0:1788970270.951146:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17391:x1875870732136832:12345-192.168.202.9@tcp:700:lfs.0 Request processed in 96us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.951155:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788970270.952903:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970270.952988:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137088 00000100:00100000:0.0:1788970270.952996:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137088 00000100:00100000:0.0:1788970270.953049:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00100000:0.0:1788970270.953058:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17391:x1875870732137088:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:0.0:1788970270.953113:0:18925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970270.953141:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788a00/0x5d0de860b05b5656 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ee7e expref: 9 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.953160:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:0.0:1788970270.953166:0:18925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970270.953396:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.953410:0:18925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 5 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.953418:0:18925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.953458:0:18925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 5 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970270.953473:0:18925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 5 pid: 18926 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970270.953501:0:18925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741562752:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970270.953588:0:18925:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778513f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788970270.956299:0:18925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855c16580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741562752:192.168.202.9@tcp:104: 00010000:00010000:3.0:1788970270.956328:0:18925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970270.958215:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970270.958321:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137216 00000100:00100000:2.0:1788970270.958333:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137216 00010000:00010000:2.0:1788970270.958443:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 6 pid: 18926 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970270.958490:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970270.958500:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2353:x1875870732137216:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970270.958520:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970270.958527:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 6 pid: 18926 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958554:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 6 pid: 18926 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958577:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b568e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eee0 expref: 6 pid: 18926 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958597:0:19359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:2.0:1788970270.958603:0:19359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958612:0:19359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958619:0:19359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970270.958650:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970270.958704:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2353:x1875870732137216:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 205us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970270.958712:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00010000:00010000:3.0:1788970270.959833:0:18925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.959845:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.959880:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.959905:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.959915:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970270.961235:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788970270.961250:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961260:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961266:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961272:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970270.961276:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961283:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961298:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977858b3c900) 00010000:00010000:3.0:1788970270.961301:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970270.961306:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.961312:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f93400/0x5d0de860b05b571a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970270.961343:0:18925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030bf9162 reply state 000000003dd4454c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970270.961352:0:18925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970270.961451:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+10:17391:x1875870732137088:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 8391us (8554us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788970270.961460:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 19 00000100:00080000:0.0:1788970270.962381:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788970270.963978:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.963995:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.964002:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.964009:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970270.964013:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.964022:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.964039:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff977850e18900) 00010000:00010000:3.0:1788970270.964043:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970270.964047:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970270.964053:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5721 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.035299:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.035398:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137344 00000100:00100000:3.0:1788970271.035409:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137344 00000100:00100000:3.0:1788970271.035522:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:3.0:1788970271.035533:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17399:x1875870732137344:12345-192.168.202.9@tcp:101:lctl.0 00010000:00010000:3.0:1788970271.035561:0:20340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.035585:0:20340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4eefc expref: -99 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035655:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b572f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035669:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b572f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035681:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b572f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.035720:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970271.035723:0:20340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970271.035762:0:20340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b572f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035785:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eefc expref: 11 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035828:0:20340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5e00/0x5d0de860b05b572f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4eefc expref: 10 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.035836:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.035850:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970271.035865:0:20340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5e00, rc 0) 00000100:00100000:3.0:1788970271.035934:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+10:17399:x1875870732137344:12345-192.168.202.9@tcp:101:lctl.0 Request processed in 403us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.035942:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 20 00000100:00100000:2.0:1788970271.062750:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.062933:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137472 00000100:00100000:3.0:1788970271.062944:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137472 00000100:00100000:3.0:1788970271.063011:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:3.0:1788970271.063022:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:17400:x1875870732137472:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970271.063043:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.063064:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef03 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063129:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b573d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063144:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b573d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063158:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b573d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.063195:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970271.063199:0:18927:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970271.063215:0:18927:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b573d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063240:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef03 expref: 7 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063278:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5a00/0x5d0de860b05b573d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef03 expref: 6 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.063285:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.063289:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970271.063292:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5a00, rc 0) 00000100:00100000:3.0:1788970271.063365:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:17400:x1875870732137472:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 336us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.063373:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 21 00000100:00100000:0.0:1788970271.068831:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.068944:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137600 00000100:00100000:3.0:1788970271.068955:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137600 00000100:00100000:3.0:1788970271.069015:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:3.0:1788970271.069025:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:17400:x1875870732137600:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970271.069046:0:20340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.069065:0:20340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef0a expref: -99 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069134:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069147:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069159:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069173:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069198:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069204:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069299:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069307:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069313:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.069342:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970271.069345:0:20340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970271.069373:0:20340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069387:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069394:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069401:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069408:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.069412:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069427:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069439:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.069442:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.069447:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069453:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b574b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069471:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069477:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069484:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069488:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.069490:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069496:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069502:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff977850e18000) 00010000:00010000:3.0:1788970271.069504:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.069507:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069522:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5752 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069554:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b5744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef0a expref: 8 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069568:0:20340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef0a expref: 7 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.069575:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977850e18c00) 00010000:00010000:3.0:1788970271.069577:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970271.069580:0:20340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:3.0:1788970271.069639:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+7:17400:x1875870732137600:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 616us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.069647:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:2.0:1788970271.073168:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.073250:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732137856 00000100:00100000:3.0:1788970271.073260:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732137856 00000100:00100000:3.0:1788970271.073325:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:3.0:1788970271.073335:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+7:17400:x1875870732137856:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970271.073367:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.073391:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef11 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.073493:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788970271.073615:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5760 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef11 expref: 9 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.073645:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.073648:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970271.073653:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef11 expref: 9 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.073667:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5200, rc 0) 00000100:00100000:3.0:1788970271.073785:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+8:17400:x1875870732137856:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 450us (626us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788970271.073828:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 23 00000100:00100000:0.0:1788970271.077628:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.077750:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732138112 00000100:00100000:3.0:1788970271.077769:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732138112 00000100:00100000:3.0:1788970271.078061:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 24 00000100:00100000:3.0:1788970271.078072:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+8:17400:x1875870732138112:12345-192.168.202.9@tcp:36:lfs.0 00010000:00010000:3.0:1788970271.078127:0:20340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970271.078153:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5759 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef0a expref: 8 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.078169:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977850e18c00) 00010000:00010000:3.0:1788970271.078179:0:20340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970271.078207:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.078218:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.078228:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970271.078695:0:20340:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090119f40 reply state 00000000bd38320c transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970271.078706:0:20340:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788970271.078713:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788970271.078912:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+9:17400:x1875870732138112:12345-192.168.202.9@tcp:36:lfs.0 Request processed in 841us (1293us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788970271.078920:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 24 00010000:00010000:0.0:1788970271.084603:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084624:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084632:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084638:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970271.084642:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084649:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084664:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977850e18000) 00010000:00010000:0.0:1788970271.084667:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788970271.084672:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.084678:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5c00/0x5d0de860b05b576e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970271.086261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.086347:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732138368 00000100:00100000:3.0:1788970271.086364:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732138368 00000100:00100000:3.0:1788970271.086427:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788970271.086438:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+8:17400:x1875870732138368:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:3.0:1788970271.086693:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+9:17400:x1875870732138368:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 256us (438us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788970271.086701:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1788970271.089912:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.090038:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732138624 00000100:00100000:3.0:1788970271.090050:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732138624 00000100:00100000:3.0:1788970271.090111:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:3.0:1788970271.090124:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+9:17400:x1875870732138624:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970271.090151:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.090171:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef18 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090246:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090260:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090288:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090304:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090312:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090318:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.090456:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788970271.090547:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090555:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090561:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090566:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.090570:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090578:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090590:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.090593:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.090605:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090612:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b577c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090626:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090633:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090638:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090644:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.090646:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090652:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090659:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff977850e18c00) 00010000:00010000:3.0:1788970271.090661:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.090663:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090668:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b5783 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090705:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5775 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef18 expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090729:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.090731:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970271.090735:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b5775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef18 expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.090751:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:3.0:1788970271.090878:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778812e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+10:17400:x1875870732138624:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 755us (975us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788970271.090886:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 25 00000100:00100000:2.0:1788970271.093870:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.093988:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732138752 00000100:00100000:0.0:1788970271.093997:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732138752 00000100:00100000:0.0:1788970271.094057:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:0.0:1788970271.094067:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+10:17400:x1875870732138752:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970271.094090:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970271.094112:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b5791 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef1f expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094201:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094214:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094226:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970271.094251:0:18926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788970271.094254:0:18926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970271.094275:0:18926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094301:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92000/0x5d0de860b05b5791 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 12 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094318:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 11 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.094326:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977849672200) 00010000:00010000:0.0:1788970271.094329:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970271.094348:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:0.0:1788970271.094421:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+11:17400:x1875870732138752:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 355us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.094436:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 26 00000100:00100000:2.0:1788970271.096907:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.097000:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732138880 00000100:00100000:1.0:1788970271.097009:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732138880 00000100:00100000:1.0:1788970271.097062:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:1.0:1788970271.097072:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778813b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+11:16774:x1875870732138880:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970271.097088:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970271.097105:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977743789e00/0x5d0de860b05b579f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef26 expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.097133:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977743789e00/0x5d0de860b05b579f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef26 expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.097144:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977743789e00/0x5d0de860b05b579f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef26 expref: 12 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.097171:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743789e00, rc 0) 00000100:00100000:1.0:1788970271.097229:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778813b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732138880:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 158us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.097236:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 113 00000100:00100000:2.0:1788970271.099682:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.099772:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139008 00000100:00100000:3.0:1788970271.099781:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139008 00000100:00100000:3.0:1788970271.099873:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:3.0:1788970271.099884:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732139008:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970271.100185:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732139008:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 302us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.100193:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 114 00000100:00100000:2.0:1788970271.102144:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.102258:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139136 00000100:00100000:0.0:1788970271.102267:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139136 00000100:00100000:0.0:1788970271.102325:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:0.0:1788970271.102335:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732139136:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970271.102585:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732139136:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 250us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.102593:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 115 00000100:00100000:2.0:1788970271.106408:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.106578:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139264 00000100:00100000:1.0:1788970271.106588:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139264 00000100:00100000:1.0:1788970271.106693:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:1.0:1788970271.106705:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+12:16774:x1875870732139264:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970271.106723:0:18919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970271.106741:0:18919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff977743789000/0x5d0de860b05b57a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef2d expref: -99 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.106782:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff977743789000/0x5d0de860b05b57a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef2d expref: 13 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.106836:0:18919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff977743789000/0x5d0de860b05b57a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef2d expref: 13 pid: 18919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.106844:0:18919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743789000, rc 0) 00000100:00100000:1.0:1788970271.106903:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16774:x1875870732139264:12345-192.168.202.9@tcp:101:ll_cfg_requeue.0 Request processed in 201us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.106911:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 116 00000100:00100000:2.0:1788970271.109062:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.109139:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139392 00000100:00100000:3.0:1788970271.109149:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139392 00000100:00100000:3.0:1788970271.109206:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 117 00000100:00100000:3.0:1788970271.109216:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16774:x1875870732139392:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970271.109526:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16774:x1875870732139392:12345-192.168.202.9@tcp:501:ll_cfg_requeue.0 Request processed in 310us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.109533:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 117 00000040:00080000:1.0:1788970271.110684:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788970271.113468:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.113596:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139520 00000100:00100000:3.0:1788970271.113620:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139520 00000100:00100000:3.0:1788970271.113680:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788970271.113691:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+11:17400:x1875870732139520:12345-192.168.202.9@tcp:37:lfs.0 00000100:00100000:2.0:1788970271.117292:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.117397:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139648 00000100:00100000:1.0:1788970271.117408:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139648 00000100:00100000:1.0:1788970271.117473:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:1.0:1788970271.117500:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16774:x1875870732139648:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970271.117717:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:16774:x1875870732139648:12345-192.168.202.9@tcp:503:ll_cfg_requeue.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.117725:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 118 00000100:00100000:2.0:1788970271.121362:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b73a2-3d43-4c86-aa18-b7a82e944807+11:17400:x1875870732139520:12345-192.168.202.9@tcp:37:lfs.0 Request processed in 7661us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970271.121382:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:2.0:1788970271.126005:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.126155:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732139904 00000100:00100000:1.0:1788970271.126166:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732139904 00000100:00100000:1.0:1788970271.126227:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:1.0:1788970271.126237:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f473050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+11:17400:x1875870732139904:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:1.0:1788970271.126627:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f473050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b73a2-3d43-4c86-aa18-b7a82e944807+12:17400:x1875870732139904:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 390us (630us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788970271.126634:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788970271.171279:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.171337:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732140032 00000100:00100000:3.0:1788970271.171348:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732140032 00000100:00100000:3.0:1788970271.171570:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:3.0:1788970271.171581:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+10:17408:x1875870732140032:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:3.0:1788970271.171601:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.171622:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b57ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef34 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171685:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171700:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171711:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171724:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171730:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171736:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171946:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b57c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171968:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b57c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.171976:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b57c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.172007:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788970271.172011:0:18927:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970271.172048:0:18927:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b57c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172060:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172067:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172072:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172078:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.172083:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172090:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172103:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.172106:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.172111:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172130:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b57b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172143:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172149:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172154:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172160:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.172163:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172168:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172175:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff977850e18c00) 00010000:00010000:3.0:1788970271.172178:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.172181:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172186:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b57bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172217:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b57ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef34 expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172248:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4c00/0x5d0de860b05b57c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef34 expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.172255:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977849672200) 00010000:00010000:3.0:1788970271.172258:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788970271.172261:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4c00, rc 0) 00000100:00100000:3.0:1788970271.172517:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+11:17408:x1875870732140032:12345-192.168.202.9@tcp:101:bash.0 Request processed in 936us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.172525:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 27 00000100:00100000:0.0:1788970271.179673:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.179746:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732140288 00000100:00100000:2.0:1788970271.179756:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732140288 00000100:00100000:2.0:1788970271.179836:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 28 00000100:00100000:2.0:1788970271.179846:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+11:17408:x1875870732140288:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:2.0:1788970271.179876:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970271.179897:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b57c9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef3b expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.180020:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.180036:0:18926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 11 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.180045:0:18926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.180078:0:18926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 11 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.180092:0:18926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 11 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.180117:0:18926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787dce4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18926:1875870741562880:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970271.180199:0:18926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970271.182705:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.182780:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732140416 00000100:00100000:3.0:1788970271.182807:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732140416 00010000:00010000:3.0:1788970271.182841:0:18910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 12 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970271.182921:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:1.0:1788970271.182938:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+12:2353:x1875870732140416:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970271.182954:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970271.182963:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 12 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.182979:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 12 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183001:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977849672200) 00010000:00010000:1.0:1788970271.183007:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183018:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183043:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183063:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788970271.183106:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5798 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef1f expref: 12 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970271.183122:0:18926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787dce4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18926:1875870741562880:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970271.183134:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+11:2353:x1875870732140416:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 200us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.183144:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00010000:00010000:0.0:1788970271.183146:0:18926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.183156:0:18926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.183162:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183213:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183225:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.183233:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184035:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184047:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184054:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970271.184064:0:18926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788970271.184092:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184100:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184118:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184125:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970271.184129:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184137:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184147:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977849672200) 00010000:00010000:1.0:1788970271.184150:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970271.184154:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184160:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b57d0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970271.184172:0:18926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ddbff9d reply state 00000000d574d25f transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970271.184180:0:18926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788970271.184214:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b57c9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 14 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184230:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 13 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.184237:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788970271.184239:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788970271.184247:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743788e00, rc 0) 00000100:00100000:1.0:1788970271.184306:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17408:x1875870732140288:12345-192.168.202.9@tcp:101:bash.0 Request processed in 4461us (4642us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788970271.184314:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 28 00010000:00010000:3.0:1788970271.186069:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186084:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186092:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186099:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970271.186103:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186111:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186138:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff977849672600) 00010000:00010000:3.0:1788970271.186141:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970271.186146:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.186152:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788600/0x5d0de860b05b57d7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.199052:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.199152:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732140544 00000100:00100000:0.0:1788970271.199163:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732140544 00000100:00100000:0.0:1788970271.199236:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:0.0:1788970271.199245:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+13:17408:x1875870732140544:12345-192.168.202.9@tcp:101:bash.0 00010000:00010000:0.0:1788970271.199271:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970271.199291:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b57ec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef42 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199367:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199382:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199392:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970271.199440:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788970271.199445:0:18925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788970271.199464:0:18925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199475:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199499:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b57ec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 15 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199516:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 14 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.199524:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.199532:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970271.199536:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92600, rc 0) 00000100:00100000:0.0:1788970271.199600:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17408:x1875870732140544:12345-192.168.202.9@tcp:101:bash.0 Request processed in 355us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.199607:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 29 00000100:00100000:2.0:1788970271.203029:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.203294:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732140800 00000100:00100000:1.0:1788970271.203305:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732140800 00000100:00100000:1.0:1788970271.203361:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:1.0:1788970271.203373:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17408:x1875870732140800:12345-192.168.202.9@tcp:35:bash.0 00000100:00100000:1.0:1788970271.203923:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:17408:x1875870732140800:12345-192.168.202.9@tcp:35:bash.0 Request processed in 550us (900us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788970271.203932:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:2.0:1788970271.274239:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.274329:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732141056 00000100:00100000:3.0:1788970271.274338:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732141056 00000100:00100000:3.0:1788970271.274412:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:3.0:1788970271.274430:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:17418:x1875870732141056:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:3.0:1788970271.274455:0:20340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970271.274474:0:20340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b57fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef49 expref: -99 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970271.274558:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788970271.274672:0:20340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b57fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef49 expref: 17 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.274686:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff977850e18900) 00010000:00010000:3.0:1788970271.274689:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788970271.274694:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b57fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef49 expref: 17 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.274712:0:20340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff4e00, rc 0) 00000100:00100000:3.0:1788970271.274781:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+16:17418:x1875870732141056:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 360us (551us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788970271.275124:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 30 00000100:00100000:0.0:1788970271.278704:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.278841:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732141312 00000100:00100000:2.0:1788970271.278865:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732141312 00000100:00100000:2.0:1788970271.278929:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970271.278939:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+16:17418:x1875870732141312:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970271.279175:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+17:17418:x1875870732141312:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 238us (479us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788970271.279183:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:2.0:1788970271.314313:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.314452:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732141568 00000100:00100000:0.0:1788970271.314462:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732141568 00000100:00100000:0.0:1788970271.314522:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:0.0:1788970271.314532:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+17:17421:x1875870732141568:12345-192.168.202.9@tcp:101:lfs.0 00010000:00010000:0.0:1788970271.314558:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970271.314580:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5808 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef50 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.314687:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b580f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.314702:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b580f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.314713:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b580f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970271.314724:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788970271.314904:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b5808 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef50 expref: 20 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.314922:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b580f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef50 expref: 19 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.314948:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.314951:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970271.314954:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92a00, rc 0) 00000100:00100000:0.0:1788970271.315011:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17421:x1875870732141568:12345-192.168.202.9@tcp:101:lfs.0 Request processed in 480us (708us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788970271.315018:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 31 00000100:00100000:3.0:1788970271.318205:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.318253:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.318341:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732141696 00000100:00100000:2.0:1788970271.318351:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732141696 00000100:00100000:2.0:1788970271.318426:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:2.0:1788970271.318438:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17421:x1875870732141696:12345-192.168.202.9@tcp:54:lfs.0 00010000:00010000:2.0:1788970271.318501:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318517:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318530:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318573:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318580:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318587:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318593:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970271.318597:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318604:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318615:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970271.318618:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970271.318622:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.318628:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b581d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.318702:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17421:x1875870732141696:12345-192.168.202.9@tcp:54:lfs.0 Request processed in 266us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970271.318710:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 32 00000100:00100000:0.0:1788970271.319028:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732141824 00000100:00100000:0.0:1788970271.319035:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732141824 00000100:00100000:0.0:1788970271.319078:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970271.319087:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:2355:x1875870732141824:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970271.319098:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970271.319113:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b580f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef50 expref: 19 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.319125:0:19359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.319129:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970271.319161:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+18:2355:x1875870732141824:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 76us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.319167:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788970271.322211:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.322289:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732142080 00000100:00100000:2.0:1788970271.322299:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732142080 00000100:00100000:2.0:1788970271.322369:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788970271.322395:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+18:17421:x1875870732142080:12345-192.168.202.9@tcp:35:lfs.0 00000100:00100000:2.0:1788970271.322649:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17421:x1875870732142080:12345-192.168.202.9@tcp:35:lfs.0 Request processed in 255us (448us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788970271.322656:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:2.0:1788970271.540513:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.540606:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732142336 00000100:00100000:0.0:1788970271.540616:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732142336 00000100:00100000:0.0:1788970271.540673:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:0.0:1788970271.540684:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17452:x1875870732142336:12345-192.168.202.9@tcp:101:cat.0 00010000:00010000:0.0:1788970271.540708:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970271.540728:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5824 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef57 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.540936:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b582b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.540950:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b582b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.540962:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b582b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970271.540973:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788970271.541116:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5824 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef57 expref: 22 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.541133:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b582b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef57 expref: 21 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.541141:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.541144:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788970271.541147:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977880f92200, rc 0) 00000100:00100000:0.0:1788970271.541205:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:17452:x1875870732142336:12345-192.168.202.9@tcp:101:cat.0 Request processed in 523us (701us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788970271.541212:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 33 00000100:00100000:3.0:1788970271.545494:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.545595:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732142592 00000100:00100000:2.0:1788970271.545606:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732142592 00000100:00100000:2.0:1788970271.545670:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970271.545680:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:17452:x1875870732142592:12345-192.168.202.9@tcp:35:cat.0 00000100:00100000:2.0:1788970271.546059:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+22:17452:x1875870732142592:12345-192.168.202.9@tcp:35:cat.0 Request processed in 379us (573us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788970271.546066:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 8 00000100:00100000:2.0:1788970271.549265:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.549365:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732142720 00000100:00100000:3.0:1788970271.549374:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732142720 00000100:00100000:3.0:1788970271.549450:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:3.0:1788970271.549460:0:18910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+22:2356:x1875870732142720:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970271.549475:0:18910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970271.549501:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b582b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef57 expref: 22 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.549519:0:18910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:3.0:1788970271.549524:0:18910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970271.549580:0:18910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:2356:x1875870732142720:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 122us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.549586:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00010000:00010000:2.0:1788970271.556975:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970271.602017:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.602200:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732142976 00000100:00100000:2.0:1788970271.602210:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732142976 00000100:00100000:2.0:1788970271.602330:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:2.0:1788970271.602341:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:17458:x1875870732142976:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1788970271.602376:0:20340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970271.602396:0:20340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5839 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef5e expref: -99 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602504:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602518:0:20340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 22 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602545:0:20340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 22 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602553:0:20340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602587:0:20340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 22 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602601:0:20340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 22 pid: 18925 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.602614:0:20340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20340:1875870741563008:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970271.602773:0:20340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 22 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.602783:0:20340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 22 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.602821:0:20340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20340:1875870741563136:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970271.605959:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970271.605987:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.606084:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732143104 00000100:00100000:0.0:1788970271.606093:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732143104 00010000:00010000:0.0:1788970271.606133:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 23 pid: 18925 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970271.606173:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732143232 00000100:00100000:0.0:1788970271.606189:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732143232 00010000:00010000:0.0:1788970271.606204:0:19359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 6/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 24 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970271.606227:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:0.0:1788970271.606236:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977851faa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:2353:x1875870732143104:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970271.606250:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970271.606256:0:19359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 24 pid: 18925 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.606269:0:19359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 24 pid: 18925 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.606289:0:19359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.606295:0:19359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.606303:0:19359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.606309:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970271.606449:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:3.0:1788970271.606459:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:2353:x1875870732143232:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970271.606467:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970271.606473:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 6/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 24 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.606489:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 24 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.606502:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:3.0:1788970271.606505:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.606513:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.606520:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970271.606538:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970271.606575:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977851faa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:2353:x1875870732143104:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 340us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.606582:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970271.607255:0:20340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9778603c39c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788970271.607291:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92600/0x5d0de860b05b57f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef42 expref: 23 pid: 18925 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.607309:0:20340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20340:1875870741563008:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970271.607336:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788e00/0x5d0de860b05b57de lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef3b expref: 22 pid: 18926 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.607346:0:20340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20340:1875870741563136:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970271.607383:0:20340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.607393:0:20340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.607398:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970271.607425:0:20340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970271.607602:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b5839 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef5e expref: 23 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.607617:0:20340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031200/0x5d0de860b05b5840 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef5e expref: 22 pid: 20340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.607625:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970271.607628:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788970271.607631:0:20340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031200, rc 0) 00000100:00100000:3.0:1788970271.607874:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+22:2353:x1875870732143232:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 1415us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970271.607882:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1788970271.609499:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:17458:x1875870732142976:12345-192.168.202.9@tcp:101:dd.0 Request processed in 7063us (7395us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788970271.609512:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 34 00000100:00100000:3.0:1788970271.612106:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.612238:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732143488 00000100:00100000:2.0:1788970271.612249:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732143488 00000100:00100000:2.0:1788970271.612325:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 35 00000100:00100000:2.0:1788970271.612335:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+21:17458:x1875870732143488:12345-192.168.202.9@tcp:36:dd.0 00010000:00010000:2.0:1788970271.612636:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.612656:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.612667:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970271.612719:0:18925:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788970271.612748:0:18925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7b8a870 reply state 0000000046c664a9 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970271.612755:0:18925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970271.613240:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f358f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17458:x1875870732143488:12345-192.168.202.9@tcp:36:dd.0 Request processed in 905us (1142us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788970271.613248:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 35 00000020:00080000:2.0:1788970271.613254:0:18925:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788970271.616015:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.616119:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732143616 00000100:00100000:2.0:1788970271.616130:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732143616 00000100:00100000:2.0:1788970271.616181:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 36 00000100:00100000:2.0:1788970271.616191:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17458:x1875870732143616:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:2.0:1788970271.616216:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970271.616235:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5855 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef65 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.616293:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5855 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef65 expref: 25 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.616327:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5855 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef65 expref: 25 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.616353:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970271.616357:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970271.616360:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030800, rc 0) 00000100:00100000:2.0:1788970271.616409:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17458:x1875870732143616:12345-192.168.202.9@tcp:101:dd.0 Request processed in 220us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970271.616426:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 36 00010000:00010000:0.0:1788970271.617089:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617098:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617118:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617124:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:0.0:1788970271.617128:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617136:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617147:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:0.0:1788970271.617150:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970271.617154:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.617160:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b584e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970271.629978:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970271.630126:0:19359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732143872 00000100:00100000:2.0:1788970271.630137:0:19359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732143872 00000100:00100000:2.0:1788970271.630238:0:19359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:2.0:1788970271.630249:0:19359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17458:x1875870732143872:12345-192.168.202.9@tcp:103:dd.0 00010000:00010000:2.0:1788970271.630264:0:19359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970271.630286:0:19359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b5855 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef65 expref: 24 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970271.630304:0:19359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970271.630309:0:19359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970271.630418:0:19359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+23:17458:x1875870732143872:12345-192.168.202.9@tcp:103:dd.0 Request processed in 164us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970271.630426:0:19359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788970271.632228:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970271.632374:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144000 00000100:00100000:0.0:1788970271.632383:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144000 00000100:00100000:0.0:1788970271.632445:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:0.0:1788970271.632454:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+23:17458:x1875870732144000:12345-192.168.202.9@tcp:58:dd.0 00010000:00010000:0.0:1788970271.632545:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.632562:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970271.632574:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970271.633360:0:18927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970271.633521:0:18927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788970271.633597:0:18927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788970271.634198:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+23:17458:x1875870732144000:12345-192.168.202.9@tcp:58:dd.0 Request processed in 1740us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970271.634208:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 37 00000100:00100000:3.0:1788970271.636556:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970271.636637:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144128 00000100:00100000:1.0:1788970271.636647:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144128 00000100:00100000:1.0:1788970271.636703:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:1.0:1788970271.636714:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+23:17458:x1875870732144128:12345-192.168.202.9@tcp:101:dd.0 00010000:00010000:1.0:1788970271.636733:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970271.636753:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef6c expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636835:0:18926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636845:0:18926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 24 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636874:0:18926:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636907:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 24 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636920:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788970271.636924:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970271.636927:0:18926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 24 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970271.636935:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743789800, rc 0) 00000100:00100000:1.0:1788970271.636982:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17458:x1875870732144128:12345-192.168.202.9@tcp:101:dd.0 Request processed in 271us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.636989:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 38 00000100:00100000:3.0:1788970271.685342:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741563264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970271.685434:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970271.685589:0:19612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741563264 00000100:00100000:1.0:1788970271.685599:0:19612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741563264 00000100:00100000:1.0:1788970271.685652:0:19612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970271.685661:0:19612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741563264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970271.685697:0:19612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788970271.685753:0:19612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875870741563264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970271.685760:0:19612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970271.685988:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875870741563264:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788970272.136241:0:18957:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788970272.136251:0:18957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970272.136300:0:18957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788970272.136308:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788970272.136432:0:18957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18957:1875870741563392:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970272.136743:0:18957:0:(client.c:2716:ptlrpc_set_wait()) set ffff97786f2ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970272.146253:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.146466:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144256 00000100:00100000:0.0:1788970272.146476:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144256 00000100:00100000:0.0:1788970272.146553:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:0.0:1788970272.146566:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732144256:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788970272.146641:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732144256:12345-192.168.202.9@tcp:900:lhsmtool_posix.0 Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970272.146648:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00080000:3.0:1788970272.146802:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970272.146947:0:18957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e92580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18957:1875870741563392:192.168.202.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788970272.151949:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.154988:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144384 00000100:00100000:2.0:1788970272.155006:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144384 00000100:00100000:2.0:1788970272.155095:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:2.0:1788970272.155106:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17459:x1875870732144384:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970272.155154:0:18925:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788970272.155273:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17459:x1875870732144384:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 169us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970272.155278:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 39 00000100:00100000:0.0:1788970272.160884:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.160974:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144512 00000100:00100000:1.0:1788970272.160985:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144512 00000100:00100000:1.0:1788970272.161052:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:1.0:1788970272.161062:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17459:x1875870732144512:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788970272.161126:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161140:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161150:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161160:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161165:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161168:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161184:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161189:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161193:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970272.161253:0:18926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788970272.161258:0:18926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788970272.161276:0:18926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161289:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161295:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161302:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161308:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970272.161312:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161319:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161332:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff977850e18800) 00010000:00010000:1.0:1788970272.161335:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970272.161341:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161346:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788400/0x5d0de860b05b586a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161359:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161374:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161380:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161385:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789c00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970272.161388:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161394:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161399:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff977858b3ca00) 00010000:00010000:1.0:1788970272.161401:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970272.161403:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161406:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b5871 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161419:0:18926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161422:0:18926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161426:0:18926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161429:0:18926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743788800 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970272.161435:0:18926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161441:0:18926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161448:0:18926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:1.0:1788970272.161450:0:18926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970272.161452:0:18926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.161457:0:18926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5878 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.161520:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17459:x1875870732144512:12345-192.168.202.9@tcp:34:lhsmtool_posix.0 Request processed in 460us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.161526:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 40 00000100:00100000:3.0:1788970272.164762:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.166164:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144768 00000100:00100000:2.0:1788970272.166177:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144768 00000100:00100000:2.0:1788970272.166232:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:2.0:1788970272.166238:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+24:17459:x1875870732144768:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970272.166255:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970272.166272:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b587f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef73 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166361:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166375:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166387:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970272.166399:0:18925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970272.166493:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166501:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166506:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166519:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031400 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970272.166523:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166537:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166546:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970272.166548:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788970272.166552:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166556:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b5886 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166588:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b587f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef73 expref: 26 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166594:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff977850e18800) 00010000:00010000:2.0:1788970272.166596:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970272.166598:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b587f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef73 expref: 26 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.166605:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030800, rc 0) 00000100:00100000:2.0:1788970272.166658:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732144768:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 419us (1908us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788970272.166665:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 41 00000100:00100000:0.0:1788970272.170060:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.170135:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732144896 00000100:00100000:3.0:1788970272.170145:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732144896 00000100:00100000:3.0:1788970272.170209:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:3.0:1788970272.170220:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732144896:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788970272.170254:0:20340:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788970272.170374:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732144896:12345-192.168.202.9@tcp:53:lhsmtool_posix.0 Request processed in 156us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.170382:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 42 00000100:00100000:0.0:1788970272.174408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.174602:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732145152 00000100:00100000:1.0:1788970272.174616:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732145152 00000100:00100000:1.0:1788970272.174681:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:1.0:1788970272.174691:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+25:17459:x1875870732145152:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970272.174712:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970272.174732:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5894 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef7a expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788970272.175656:0:18927:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:1.0:1788970272.175665:0:18927:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788970272.175724:0:18927:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788970272.176117:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b589b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.176145:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b589b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.176157:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b589b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.176219:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743788800/0x5d0de860b05b5894 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef7a expref: 28 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.176236:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b589b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef7a expref: 27 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.176244:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977858b3ca00) 00010000:00010000:1.0:1788970272.176247:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970272.176250:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743789c00, rc 0) 00000100:00100000:1.0:1788970272.176306:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855c17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+27:17459:x1875870732145152:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 1616us (1908us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1788970272.176314:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 43 00000100:00100000:0.0:1788970272.180317:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.180528:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732145408 00000100:00100000:3.0:1788970272.180538:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732145408 00000100:00100000:3.0:1788970272.180630:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:3.0:1788970272.180640:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+27:17459:x1875870732145408:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970272.180696:0:20340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970272.180722:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977743789c00/0x5d0de860b05b589b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef7a expref: 27 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180742:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977858b3ca00) 00010000:00010000:3.0:1788970272.180754:0:20340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970272.180925:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180940:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180950:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180964:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180986:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.180994:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181061:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181069:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181075:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181081:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970272.181086:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181093:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181101:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff977849672200) 00010000:00010000:3.0:1788970272.181104:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970272.181108:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181113:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58a9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181123:0:20340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181136:0:20340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181141:0:20340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181146:0:20340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970272.181149:0:20340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181155:0:20340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181162:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x78a2f1ac (ffff977850e18c00) 00010000:00010000:3.0:1788970272.181164:0:20340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970272.181166:0:20340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.181171:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58b0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x78a2f1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.181318:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+26:17459:x1875870732145408:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 679us (1010us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970272.181326:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 44 00000100:00100000:0.0:1788970272.184209:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.184303:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732145536 00000100:00100000:2.0:1788970272.184325:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732145536 00000100:00100000:2.0:1788970272.184531:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:2.0:1788970272.184542:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+26:17459:x1875870732145536:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970272.184562:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970272.184585:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b58b7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef81 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184621:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b58be lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184634:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b58be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184647:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b58be lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184739:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030800/0x5d0de860b05b58b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef81 expref: 28 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184892:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031400/0x5d0de860b05b58be lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef81 expref: 27 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.184904:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970272.184907:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970272.184910:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840031400, rc 0) 00000100:00100000:2.0:1788970272.185013:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+27:17459:x1875870732145536:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 472us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970272.185020:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 45 00000100:00100000:0.0:1788970272.187382:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.188010:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732145792 00000100:00100000:2.0:1788970272.188040:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732145792 00000100:00100000:2.0:1788970272.188101:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 46 00000100:00100000:2.0:1788970272.188111:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+27:17459:x1875870732145792:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970272.188198:0:18926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.188217:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.188229:0:18926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970272.188822:0:18926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1788970272.188833:0:18926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584152042319ns, next at 585152040080ns, rc = 0 00000004:00010000:2.0:1788970272.188929:0:18926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de028536 reply state 000000006f281350 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.188939:0:18926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970272.189048:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97784eb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+29:17459:x1875870732145792:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 935us (1674us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788970272.189056:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 46 00010000:00010000:3.0:1788970272.191568:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191585:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191609:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191615:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840031a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:3.0:1788970272.191619:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191627:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191642:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970272.191645:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788970272.191650:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.191655:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840031a00/0x5d0de860b05b58c5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.191829:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.192285:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732145920 00000100:00100000:3.0:1788970272.192294:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732145920 00000100:00100000:3.0:1788970272.192352:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:3.0:1788970272.192361:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+28:17459:x1875870732145920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970272.192384:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970272.192399:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef88 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.192506:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 29 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.192533:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 29 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.192554:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970272.192557:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970272.192560:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5600, rc 0) 00000100:00100000:3.0:1788970272.192614:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787dce5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+29:17459:x1875870732145920:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 253us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.192621:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 47 00000100:00100000:0.0:1788970272.195263:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.195337:0:20138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732146048 00000100:00100000:2.0:1788970272.195348:0:20138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732146048 00000100:00100000:2.0:1788970272.195436:0:20138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00100000:2.0:1788970272.195447:0:20138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2353:x1875870732146048:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788970272.195827:0:20138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2353:x1875870732146048:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 381us (571us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788970272.195835:0:20138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 12 00000100:00080000:3.0:1788970272.196197:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970272.198304:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.198376:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732146304 00000100:00100000:2.0:1788970272.198385:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732146304 00000100:00100000:2.0:1788970272.198452:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970272.198462:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+29:17459:x1875870732146304:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788970272.198687:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+30:17459:x1875870732146304:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 225us (390us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788970272.198696:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:1.0:1788970272.201521:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.201645:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732146560 00000100:00100000:3.0:1788970272.201654:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732146560 00000100:00100000:3.0:1788970272.201711:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:3.0:1788970272.201721:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+30:17459:x1875870732146560:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970272.201861:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+30:17459:x1875870732146560:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.201868:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 48 00000100:00100000:0.0:1788970272.204820:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.205010:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732146688 00000100:00100000:3.0:1788970272.205021:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732146688 00000100:00100000:3.0:1788970272.205083:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:3.0:1788970272.205094:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+30:17459:x1875870732146688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970272.205116:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970272.205140:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58d3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef8f expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205249:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205264:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205277:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970272.205316:0:18927:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788970272.205335:0:18927:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205375:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58d3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef8f expref: 32 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205398:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef8f expref: 31 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.205406:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970272.205408:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788970272.205412:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977852ff5200, rc 0) 00000100:00100000:3.0:1788970272.205475:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+31:17459:x1875870732146688:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 383us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.205482:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 49 00000100:00100000:0.0:1788970272.208697:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.208835:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732146816 00000100:00100000:1.0:1788970272.208854:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732146816 00000100:00100000:1.0:1788970272.208908:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970272.208919:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+6:2354:x1875870732146816:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970272.208937:0:19611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970272.208958:0:19611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef96 expref: -99 pid: 19611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788970272.209004:0:19611:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa18520, blocks: 0x1 00010000:00010000:1.0:1788970272.209024:0:19611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1788970272.209028:0:19611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970272.209038:0:19611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 7 pid: 19611 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.209059:0:19611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 7 pid: 19611 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.209070:0:19611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977743789a00, rc 0) 00000100:00100000:1.0:1788970272.209120:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2354:x1875870732146816:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 203us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.209127:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970272.212275:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.212362:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147072 00000100:00100000:3.0:1788970272.212371:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147072 00000100:00100000:3.0:1788970272.212429:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:3.0:1788970272.212445:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+31:17459:x1875870732147072:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970272.212549:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+31:17459:x1875870732147072:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.212556:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 50 00000100:00100000:0.0:1788970272.215272:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.215442:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147200 00000100:00100000:3.0:1788970272.215452:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147200 00000100:00100000:3.0:1788970272.215509:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00100000:3.0:1788970272.215520:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+31:17459:x1875870732147200:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788970272.249097:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901902 is committed 00000001:00080000:1.0:1788970272.249114:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901908 is committed 00000001:00080000:1.0:1788970272.249127:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:1.0:1788970272.249132:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1788970272.249138:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788970272.249355:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970272.249377:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741563520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788970272.249596:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970272.249700:0:20138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741563520 00000100:00100000:1.0:1788970272.249707:0:20138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741563520 00000100:00100000:1.0:1788970272.249771:0:20138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970272.249781:0:20138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875870741563520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788970272.249979:0:20138:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788970272.249983:0:20138:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788970272.249997:0:20138:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788970272.250000:0:20138:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788970272 -> 1788970272 00002000:00010000:1.0:1788970272.250003:0:20138:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788970272.250049:0:20138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875870741563520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (453us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788970272.250057:0:20138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788970272.250106:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9778650c3840/2, rc 0, transno 12884901891 00000100:00100000:1.0:1788970272.250113:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875870741563520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788970272.250268:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17459:x1875870732147200:12345-192.168.202.9@tcp:44:lhsmtool_posix.0 Request processed in 34748us (35003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.250277:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 51 00000100:00080000:2.0:1788970272.250337:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970272.252771:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.252931:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147328 00000100:00100000:1.0:1788970272.252942:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147328 00000100:00100000:1.0:1788970272.253003:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1788970272.253013:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2353:x1875870732147328:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788970272.253119:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f35b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2353:x1875870732147328:12345-192.168.202.9@tcp:16:lhsmtool_posix.0 Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.253127:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:1.0:1788970272.255719:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.255833:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147584 00000100:00100000:3.0:1788970272.255853:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147584 00000100:00100000:3.0:1788970272.255918:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 52 00000100:00100000:3.0:1788970272.255929:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17459:x1875870732147584:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788970272.255982:0:20340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970272.256008:0:20340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b58da lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef8f expref: 14 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.256027:0:20340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970272.256032:0:20340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970272.256062:0:20340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.256075:0:20340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.256105:0:20340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788970272.256291:0:20340:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f68607b1 reply state 000000001e7194c5 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.256301:0:20340:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970272.256403:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:17459:x1875870732147584:12345-192.168.202.9@tcp:36:lhsmtool_posix.0 Request processed in 475us (693us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788970272.256411:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 52 00010000:00010000:1.0:1788970272.258605:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258621:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258629:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258635:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:1.0:1788970272.258640:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258667:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258683:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:1.0:1788970272.258686:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970272.258691:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.258697:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff4e00/0x5d0de860b05b58e8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.259421:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.259644:0:20138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147712 00000100:00100000:2.0:1788970272.259654:0:20138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147712 00000100:00100000:2.0:1788970272.259708:0:20138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 16 00000100:00100000:2.0:1788970272.259718:0:20138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:17459:x1875870732147712:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970272.259735:0:20138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970272.259754:0:20138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbf09a1a90fc4ef9d expref: -99 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.259783:0:20138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.259821:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970272.259826:0:20138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970272.259831:0:20138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 8 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.259888:0:20138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.259904:0:20138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.259919:0:20138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20138:1875870741563648:192.168.202.9@tcp:104: 00000100:00100000:2.0:1788970272.260005:0:20138:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970272.262498:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.262641:0:20138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20138:1875870741563648:192.168.202.9@tcp:104: 00000100:00100000:3.0:1788970272.262700:0:18911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147840 00000100:00100000:3.0:1788970272.262707:0:18911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147840 00010000:00010000:3.0:1788970272.262741:0:18911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 9 pid: 19611 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.262741:0:20138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 9 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.262761:0:20138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff977840030600, rc 0) 00000100:00100000:3.0:1788970272.262810:0:18911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:3.0:1788970272.262819:0:18911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2353:x1875870732147840:12345-192.168.202.9@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788970272.262828:0:20138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:17459:x1875870732147712:12345-192.168.202.9@tcp:101:lhsmtool_posix.0 Request processed in 3112us (3421us total) trans 0 rc 0/0 00010000:00010000:3.0:1788970272.262832:0:18911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788970272.262834:0:20138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 16 00010000:00010000:3.0:1788970272.262865:0:18911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.262879:0:18911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.262903:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e2b2bd/0x5d0de860b05b58e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef96 expref: 8 pid: 19611 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.262938:0:18911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.262942:0:18911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.262948:0:18911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 7 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.262957:0:18911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 7 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.262991:0:18911:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 7 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.263006:0:18911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18911:1875870741563776:192.168.202.9@tcp:105: 00000100:00100000:3.0:1788970272.263057:0:18911:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787f4ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970272.266583:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.266673:0:18911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97787f35a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18911:1875870741563776:192.168.202.9@tcp:105: 00010000:00010000:3.0:1788970272.266699:0:18911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970272.266749:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732147968 00000100:00100000:1.0:1788970272.266757:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732147968 00000100:00100000:3.0:1788970272.266768:0:18911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+8:2353:x1875870732147840:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 3942us (4270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.266777:0:18911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 13 00000100:00100000:1.0:1788970272.266828:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:1.0:1788970272.266838:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2353:x1875870732147968:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788970272.267046:0:19611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788970272.267050:0:19611:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788970272 00002000:00010000:1.0:1788970272.267052:0:19611:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788970271 00002000:00010000:1.0:1788970272.267064:0:19611:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788970272 -> 1788970272 00002000:00010000:1.0:1788970272.267067:0:19611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788970272.267111:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+8:2353:x1875870732147968:12345-192.168.202.9@tcp:2:lhsmtool_posix.0 Request processed in 274us (535us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788970272.267118:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 17 00000100:00100000:0.0:1788970272.273401:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:1.0:1788970272.273580:0:19608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148096 00000100:00100000:1.0:1788970272.273591:0:19608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148096 00000100:00100000:1.0:1788970272.273665:0:19608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:1.0:1788970272.273676:0:19608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+8:2353:x1875870732148096:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788970272.273723:0:19608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.273744:0:19608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 8 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.273753:0:19608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970272.273757:0:19608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788970272.273763:0:19608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.273829:0:19608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 8 pid: 20138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.273855:0:19608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 8 pid: 20138 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.273892:0:19608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19608:1875870741563904:192.168.202.9@tcp:104: 00000100:00100000:1.0:1788970272.273980:0:19608:0:(client.c:2716:ptlrpc_set_wait()) set ffff97787a5fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970272.276499:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.276712:0:18910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148224 00000100:00100000:1.0:1788970272.276718:0:19608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977880e912c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19608:1875870741563904:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970272.276721:0:18910:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148224 00010000:00010000:1.0:1788970272.276751:0:19608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276754:0:18910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 9 pid: 20138 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.276826:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 14 00000100:00100000:0.0:1788970272.276836:0:18910:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2354:x1875870732148224:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970272.276859:0:18910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970272.276883:0:18910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 9 pid: 20138 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276895:0:18910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 9 pid: 20138 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276919:0:18910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554af186/0x5d0de860b05b58ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef9d expref: 9 pid: 20138 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276935:0:18910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970272.276940:0:18910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788970272.276945:0:18910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276955:0:18910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.276995:0:18910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970272.277053:0:18910:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+8:2354:x1875870732148224:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 219us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970272.277061:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 14 00010000:00010000:1.0:1788970272.277298:0:19608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277307:0:19608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277331:0:19608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277340:0:19608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277348:0:19608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277356:0:19608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977743789c00 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970272.277361:0:19608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277379:0:19608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277393:0:19608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.277400:0:19608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2f5996/0x5d0de860b05b58f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.277463:0:19608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2353:x1875870732148096:12345-192.168.202.9@tcp:1:lhsmtool_posix.0 Request processed in 3789us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.277471:0:19608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 18 00000100:00100000:2.0:1788970272.293865:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.293960:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148480 00000100:00100000:0.0:1788970272.293971:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148480 00000100:00100000:0.0:1788970272.294038:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 53 00000100:00100000:0.0:1788970272.294049:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:17459:x1875870732148480:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788970272.294151:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294181:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294193:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294483:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294495:0:18925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 15 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294504:0:18925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294537:0:18925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 15 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.294564:0:18925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 15 pid: 18927 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.294580:0:18925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741564032:192.168.202.9@tcp:104: 00000100:00100000:0.0:1788970272.294671:0:18925:0:(client.c:2716:ptlrpc_set_wait()) set ffff977861d37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970272.298063:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.298200:0:18925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff977855ce8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741564032:192.168.202.9@tcp:104: 00010000:00010000:2.0:1788970272.298233:0:18925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.298357:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148608 00000100:00100000:3.0:1788970272.298365:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148608 00010000:00010000:3.0:1788970272.298412:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 16 pid: 18927 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.298453:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 15 00000100:00100000:3.0:1788970272.298479:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+16:2353:x1875870732148608:12345-192.168.202.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970272.298498:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970272.298505:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 16 pid: 18927 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298518:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 16 pid: 18927 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298699:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5600/0x5d0de860b05b58cc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef88 expref: 16 pid: 18927 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298716:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:3.0:1788970272.298721:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298731:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298739:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.298773:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970272.298887:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:2353:x1875870732148608:12345-192.168.202.9@tcp:103:ldlm_bl.0 Request processed in 410us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.298895:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 15 00010000:00010000:2.0:1788970272.299013:0:18925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.299021:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788970272.299224:0:18925:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1788970272.300337:0:18925:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788970272.300717:0:18925:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1788970272.300826:0:18925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18925:1875870741564160:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788970272.300968:0:18925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970272.301017:0:18925:0:(client.c:2716:ptlrpc_set_wait()) set ffff977858b5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970272.301203:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741564160 00000100:00100000:3.0:1788970272.301211:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741564160 00000100:00100000:3.0:1788970272.304080:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970272.304108:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18925:x1875870741564160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788970272.304372:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18925:x1875870741564160:12345-0@lo:1000:mdt00_000.0 Request processed in 277us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.304380:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970272.304630:0:18925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18925:1875870741564160:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788970272.307383:0:18925:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788970272.308637:0:18925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18925:1875870741564288:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788970272.308710:0:18925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970272.308839:0:18925:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970272.310644:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870741564288 00000100:00100000:0.0:1788970272.310659:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870741564288 00000100:00100000:0.0:1788970272.310731:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970272.310743:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18925:x1875870741564288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788970272.311044:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18925:x1875870741564288:12345-0@lo:1000:mdt00_000.0 Request processed in 305us (2333us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788970272.311052:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970272.311311:0:18925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18925:1875870741564288:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788970272.311428:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311440:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311448:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311455:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92a00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970272.311459:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311466:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311481:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970272.311485:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970272.311489:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311496:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92a00/0x5d0de860b05b5904 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311544:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311551:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311558:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311563:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92e00 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970272.311566:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311571:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311579:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970272.311581:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788970272.311589:0:18925:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311602:0:18925:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311612:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.311664:0:18925:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff977743789800/0x5d0de860b05b5863 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.9@tcp remote: 0xbf09a1a90fc4ef6c expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.311688:0:18925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741564416:192.168.202.9@tcp:105: 00000100:00100000:2.0:1788970272.311777:0:18925:0:(client.c:2716:ptlrpc_set_wait()) set ffff97784500e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970272.319268:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.319316:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.319355:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.319427:0:20340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148992 00000100:00100000:3.0:1788970272.319436:0:20340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148992 00000100:00100000:3.0:1788970272.319495:0:20340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:3.0:1788970272.319505:0:20340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2355:x1875870732148992:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:3.0:1788970272.319589:0:20340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b73a2-3d43-4c86-aa18-b7a82e944807+6:2355:x1875870732148992:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970272.319596:0:20340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 22 00000100:00100000:1.0:1788970272.319854:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148736 00000100:00100000:1.0:1788970272.319860:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148736 00000100:00100000:1.0:1788970272.319900:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:1.0:1788970272.319908:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:2355:x1875870732148736:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:1.0:1788970272.319938:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecc7d393-eb0b-4f2e-87f7-11a974cb2d16+13:2355:x1875870732148736:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970272.319944:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 119 00000100:00100000:0.0:1788970272.320070:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00080000:3.0:1788970272.322520:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970272.322768:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.327491:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149248 00000100:00100000:2.0:1788970272.327505:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149248 00000100:00100000:2.0:1788970272.327649:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732148864 00000100:00100000:2.0:1788970272.327652:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732148864 00000100:00100000:2.0:1788970272.327684:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970272.327694:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2355:x1875870732149248:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970272.327776:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2355:x1875870732149248:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 83us (8428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970272.327783:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 9 00000100:00100000:2.0:1788970272.327818:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970272.327826:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2355:x1875870732148864:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970272.327863:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2355:x1875870732148864:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 39us (7793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970272.327870:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00080000:2.0:1788970272.327895:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788970272.327899:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970272.329935:0:19611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149120 00000100:00100000:2.0:1788970272.329948:0:19611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149120 00000100:00100000:2.0:1788970272.329995:0:19611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:2.0:1788970272.330003:0:19611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2355:x1875870732149120:12345-192.168.202.9@tcp:400:kworker.0 00000100:00100000:2.0:1788970272.330059:0:19611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b73a2-3d43-4c86-aa18-b7a82e944807+5:2355:x1875870732149120:12345-192.168.202.9@tcp:400:kworker.0 Request processed in 57us (7298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970272.330082:0:19611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00080000:2.0:1788970272.330101:0:18921:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970272.332556:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.332757:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149376 00000100:00100000:0.0:1788970272.332765:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149376 00000100:00100000:0.0:1788970272.332832:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:0.0:1788970272.332852:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97787f471050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17458:x1875870732149376:12345-192.168.202.9@tcp:49:dd.0 00000100:00100000:0.0:1788970272.332978:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97787f471050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+19:17458:x1875870732149376:12345-192.168.202.9@tcp:49:dd.0 Request processed in 137us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970272.332986:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 10 00000100:00100000:2.0:1788970272.337737:0:18925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9778650c2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18925:1875870741564416:192.168.202.9@tcp:105: 00010000:00010000:2.0:1788970272.337769:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337780:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92e00/0x5d0de860b05b585c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337833:0:18925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337856:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337867:0:18925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337879:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337885:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337892:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337898:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030600 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970272.337902:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337928:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337939:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970272.337942:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970272.337946:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337950:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977840030600/0x5d0de860b05b590b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337962:0:18925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337966:0:18925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337971:0:18925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337975:0:18925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92200 already unused, calling callback (ffffffffc211a4f0) 00010000:00010000:2.0:1788970272.337977:0:18925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337983:0:18925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.337988:0:18925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff977858b3cb00) 00010000:00010000:2.0:1788970272.337990:0:18925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970272.337992:0:18925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.338005:0:18925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977880f92200/0x5d0de860b05b58fd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.338545:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+18:17459:x1875870732148480:12345-192.168.202.9@tcp:57:lhsmtool_posix.0 Request processed in 44495us (44698us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788970272.338557:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 53 00000020:00080000:2.0:1788970272.338565:0:18925:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788970272.341266:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.341554:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149632 00000100:00100000:3.0:1788970272.341565:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149632 00000100:00100000:3.0:1788970272.341665:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 11 00000100:00100000:3.0:1788970272.341676:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+18:17459:x1875870732149632:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788970272.346584:0:18928:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788970272.346718:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788970272.346815:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346832:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346854:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346864:0:18928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346882:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346888:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.346914:0:18928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788970272.347028:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+20:17459:x1875870732149632:12345-192.168.202.9@tcp:35:lhsmtool_posix.0 Request processed in 5350us (5769us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788970272.347039:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 11 00000020:00080000:3.0:1788970272.347045:0:18928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788970272.347153:0:20618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970272.347173:0:20618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.347180:0:20618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5200 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970272.347184:0:20618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.347192:0:20618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.347205:0:20618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff977851ac1400) 00010000:00010000:2.0:1788970272.347208:0:20618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788970272.347213:0:20618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.347219:0:20618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff977852ff5200/0x5d0de860b05b5912 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.347231:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970272.347232:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970272.347234:0:20618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970272.347868:0:18957:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788970272.347875:0:18957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970272.347905:0:18957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788970272.347912:0:18957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788970272.479396:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.479472:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149888 00000100:00100000:2.0:1788970272.479474:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.479481:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149888 00000100:00100000:2.0:1788970272.479500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.479541:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732149760 00000100:00100000:3.0:1788970272.479545:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732149760 00000100:00100000:3.0:1788970272.479560:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150016 00000100:00100000:3.0:1788970272.479562:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150016 00000100:00100000:3.0:1788970272.479578:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788970272.479588:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2354:x1875870732149888:12345-192.168.202.9@tcp:4:dd.0 00000100:00100000:0.0:1788970272.479592:0:19616:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788970272.479600:0:19616:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:3.0:1788970272.479636:0:19614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6aa18520, atime: 0x6aa1851f, ctime: 0x6aa18520, blocks: 0x1 00010000:00010000:3.0:1788970272.479646:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.479663:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788970272.479668:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.479675:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.479702:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.482317:0:21065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 1 00000100:00100000:0.0:1788970272.482344:0:21065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+10:2353:x1875870732149760:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:0.0:1788970272.482384:0:21065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.482421:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.482425:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.482431:0:21065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.482446:0:21065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.581679:0:18914:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970272.604215:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00000001:00080000:1.0:1788970272.604236:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000001:00080000:1.0:1788970272.604247:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:3.0:1788970272.604412:0:19614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788970272.604418:0:19614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1788970272.604432:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604446:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604455:0:19614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604463:0:19614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970272.604469:0:19614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604478:0:19614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604497:0:19614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604504:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b5919 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.604623:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+10:2354:x1875870732149888:12345-192.168.202.9@tcp:4:dd.0 Request processed in 125031us (125231us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788970272.604633:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 0 00000100:00100000:3.0:1788970272.604662:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:3.0:1788970272.604675:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2354:x1875870732150016:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:3.0:1788970272.604705:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604718:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.604723:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.604729:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.604743:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788970272.669160:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00002000:00010000:2.0:1788970272.669347:0:21065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788970272.669351:0:21065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788970272.669365:0:21065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669374:0:21065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669381:0:21065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669386:0:21065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:2.0:1788970272.669389:0:21065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669394:0:21065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669411:0:21065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.669416:0:21065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5920 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.669489:0:21065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2353:x1875870732149760:12345-192.168.202.9@tcp:4:dd.0 Request processed in 187157us (190011us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788970272.669510:0:21065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 1 00002000:00010000:3.0:1788970272.726106:0:19614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00000001:00080000:1.0:1788970272.726116:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00010000:00010000:3.0:1788970272.726127:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726140:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726149:0:19614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726177:0:19614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970272.726181:0:19614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726191:0:19614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726216:0:19614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.726225:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5927 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.726350:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2354:x1875870732150016:12345-192.168.202.9@tcp:4:dd.0 Request processed in 121669us (246837us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788970272.726359:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 2 00000100:00100000:1.0:1788970272.731570:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:3.0:1788970272.731659:0:19615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150144 00000100:00100000:3.0:1788970272.731669:0:19615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150144 00000100:00100000:3.0:1788970272.731735:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788970272.731744:0:19615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977880e912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2354:x1875870732150144:12345-192.168.202.9@tcp:4:dd.0 00002000:00010000:3.0:1788970272.731847:0:19615:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aa18520, atime: 0x6aa1851f, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788970272.731856:0:19615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.731873:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788970272.731888:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.731894:0:19615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.731908:0:19615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.740487:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:0.0:1788970272.740534:0:21065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150272 00000100:00100000:0.0:1788970272.740545:0:21065:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150272 00000100:00100000:0.0:1788970272.740607:0:21065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 4 00000100:00100000:0.0:1788970272.740617:0:21065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778615cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+7:2354:x1875870732150272:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:0.0:1788970272.740652:0:21065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.740673:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.740677:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.740683:0:21065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.740716:0:21065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970272.755926:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.755959:0:19616:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970272.755967:0:19616:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788970272.756187:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.756233:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.9@tcp (source: 12345-192.168.202.9@tcp) 00000100:00100000:2.0:1788970272.756265:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150400 00000100:00100000:2.0:1788970272.756274:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150400 00000100:00100000:2.0:1788970272.756323:0:19616:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970272.756328:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150528 00000100:00100000:2.0:1788970272.756331:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150528 00000100:00100000:2.0:1788970272.756473:0:19616:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788970272.756477:0:19614:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788970272.756480:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875870732150656 00000100:00100000:2.0:1788970272.756482:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875870732150656 00000100:00100000:2.0:1788970272.757035:0:21067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:2.0:1788970272.757046:0:21067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ddccf71-4790-4791-aebd-d7befc8b3aaa+13:2354:x1875870732150400:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:2.0:1788970272.757083:0:21067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.757197:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970272.757203:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970272.757209:0:21067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970272.757224:0:21067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970272.794906:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00002000:00010000:3.0:1788970272.794962:0:19615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:3.0:1788970272.794967:0:19615:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788970272 -> 1788970273 00002000:00010000:3.0:1788970272.794970:0:19615:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788970273 00002000:00010000:3.0:1788970272.794972:0:19615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788970272.794985:0:19615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.794994:0:19615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795000:0:19615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795005:0:19615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff5600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:3.0:1788970272.795009:0:19615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795016:0:19615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795033:0:19615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795052:0:19615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6b7af4/0x5d0de860b05b592e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970272.795133:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977880e912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:2354:x1875870732150144:12345-192.168.202.9@tcp:4:dd.0 Request processed in 63386us (63566us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788970272.795144:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 3 00000100:00100000:3.0:1788970272.795173:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 6 00000100:00100000:3.0:1788970272.795184:0:19615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+14:2354:x1875870732150528:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:3.0:1788970272.795214:0:19615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795236:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.795240:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970272.795246:0:19615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970272.795258:0:19615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970272.835055:0:21067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788970272.835067:0:21067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788970272.835081:0:21067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835095:0:21067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835104:0:21067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835112:0:21067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977840030800 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970272.835117:0:21067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835126:0:21067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835146:0:21067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835154:0:21067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3084742/0x5d0de860b05b593c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.835265:0:21067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ddccf71-4790-4791-aebd-d7befc8b3aaa+16:2354:x1875870732150400:12345-192.168.202.9@tcp:4:dd.0 Request processed in 78216us (79341us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788970272.835275:0:21067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 5 00000100:00100000:0.0:1788970272.835309:0:21067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.9@tcp, seq: 7 00000100:00100000:0.0:1788970272.835320:0:21067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ddccf71-4790-4791-aebd-d7befc8b3aaa+15:2353:x1875870732150656:12345-192.168.202.9@tcp:4:dd.0 00010000:00010000:0.0:1788970272.835361:0:21067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835373:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.835377:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970272.835383:0:21067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.835394:0:21067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970272.835745:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00000001:00080000:0.0:1788970272.835930:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00010000:00010000:1.0:1788970272.836480:0:21065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836490:0:21065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836495:0:21065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836499:0:21065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f93400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970272.836502:0:21065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836508:0:21065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836520:0:21065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.836524:0:21065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7a2994/0x5d0de860b05b5935 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.836575:0:21065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778615cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ddccf71-4790-4791-aebd-d7befc8b3aaa+11:2354:x1875870732150272:12345-192.168.202.9@tcp:4:dd.0 Request processed in 95959us (96097us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788970272.836581:0:21065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 4 00000001:00080000:3.0:1788970272.867616:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00002000:00010000:0.0:1788970272.870325:0:19615:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788970272.870347:0:19615:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1788970272.870363:0:19615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870377:0:19615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870411:0:19615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870420:0:19615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977852ff4400 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:0.0:1788970272.870424:0:19615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870434:0:19615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870454:0:19615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970272.870462:0:19615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb66f76/0x5d0de860b05b5943 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970272.870563:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9778650c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ddccf71-4790-4791-aebd-d7befc8b3aaa+9:2354:x1875870732150528:12345-192.168.202.9@tcp:4:dd.0 Request processed in 75377us (114371us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788970272.870573:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 6 00000001:00080000:3.0:1788970272.899353:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00010000:00010000:1.0:1788970272.899954:0:21067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.899969:0:21067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.899979:0:21067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.899986:0:21067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff977880f92600 already unused, calling callback (ffffffffc16ed8b0) 00010000:00010000:1.0:1788970272.899991:0:21067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.899999:0:21067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.900019:0:21067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970272.900026:0:21067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbcbe99/0x5d0de860b05b594a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970272.900125:0:21067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff977855ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ddccf71-4790-4791-aebd-d7befc8b3aaa+5:2353:x1875870732150656:12345-192.168.202.9@tcp:4:dd.0 Request processed in 64804us (143887us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788970272.900135:0:21067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.9@tcp, seq: 7 00010000:00010000:0.0:1788970273.605944:0:20619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788970274.288055:0:21105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788970274.629118:0:18913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9574 lines, 9574 kept, 0 dropped, 0 bad.