00000001:00080000:3.0F:1788211931.431549:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:3.0:1788211931.431595:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:3.0:1788211931.431600:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8abfc2cd50c0 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:3.0:1788211931.431606:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abfcaf09700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8abfc2cd5240 00000020:00080000:3.0:1788211931.431610:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8abfcaf09b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8abec5274800 00000001:00080000:3.0:1788211931.431624:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788211931.431655:0:14474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:3.0:1788211931.432439:0:14474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0F:1788211931.687030:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788211931.877933:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660886784:0@lo:400:kworker.0 00000100:00100000:0.0:1788211931.878036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211931.878103:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660887296:0@lo:400:kworker.0 00000100:00100000:0.0:1788211931.878132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211931.878160:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788211931.878182:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660886912:0@lo:400:kworker.0 00000100:00100000:0.0:1788211931.878219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211931.878237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660887424:0@lo:400:kworker.0 00000100:00100000:0.0:1788211931.878255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211931.879354:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886784 00000100:00100000:1.0:1788211931.879363:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886784 00000100:00100000:1.0:1788211931.879426:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788211931.879435:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660886784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211931.879528:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660886784:12345-0@lo:400:kworker.0 Request processed in 93us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211931.879538:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788211931.879589:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660886912 00000100:00100000:1.0:1788211931.879593:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660886912 00000100:00100000:1.0:1788211931.879634:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788211931.879642:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660886912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211931.879676:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660886912:12345-0@lo:400:kworker.0 Request processed in 36us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211931.879683:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788211931.879700:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211931.879751:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788211931.879758:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abfef8a5500, transno 8589934595 00000004:00080000:1.0:1788211931.879770:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788211931.879798:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660886912:0@lo:400:kworker.0 00000100:00100000:1.0:1788211931.879814:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660886784:0@lo:400:kworker.0 00000100:00100000:2.0F:1788211931.881914:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660887040:0@lo:400:kworker.0 00000100:00100000:2.0:1788211931.882023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211931.882078:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660887552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211931.882104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211931.882130:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788211931.882138:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660887168:0@lo:400:kworker.0 00000100:00100000:2.0:1788211931.882191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211931.882249:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887296 00000100:00100000:2.0:1788211931.882259:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887296 00000100:00100000:2.0:1788211931.882344:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887424 00000100:00100000:2.0:1788211931.882348:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887424 00000100:00100000:2.0:1788211931.882367:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887168 00000100:00100000:2.0:1788211931.882370:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887168 00000100:00100000:2.0:1788211931.882385:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788211931.882394:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211931.882692:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660887296:12345-0@lo:400:kworker.0 Request processed in 298us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211931.882702:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788211931.882725:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788211931.882732:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211931.882766:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660887424:12345-0@lo:400:kworker.0 Request processed in 35us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211931.882773:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788211931.882786:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788211931.882792:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211931.882824:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660887168:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211931.882830:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788211931.884013:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887552 00000100:00100000:1.0:1788211931.884024:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887552 00000100:00100000:1.0:1788211931.884092:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211931.884102:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660887552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211931.884135:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788211931.884229:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660887552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211931.884244:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211931.884268:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887040 00000100:00100000:1.0:1788211931.884272:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887040 00000100:00100000:1.0:1788211931.884298:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788211931.884304:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660887040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211931.884338:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660887040:12345-0@lo:400:kworker.0 Request processed in 34us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211931.884344:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211931.886003:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660887424:0@lo:400:kworker.0 00000100:00100000:3.0:1788211931.886023:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660887296:0@lo:400:kworker.0 00000100:00080000:3.0:1788211931.886079:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788211931.886086:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211931.886122:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660887680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211931.886208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211931.886268:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660887168:0@lo:400:kworker.0 00000100:00100000:3.0:1788211931.886278:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660887040:0@lo:400:kworker.0 00000100:00100000:3.0:1788211931.886295:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660887552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211931.889544:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887680 00000100:00100000:1.0:1788211931.889563:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887680 00000100:00100000:1.0:1788211931.889620:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211931.889632:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660887680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211931.889671:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211931.889771:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660887680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211931.889779:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788211931.889844:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660887680:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788211932.581606:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788211932.581617:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788211932.581655:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788211932.581663:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788211932.709365:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211933.735401:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211933.874610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211933.874676:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836544 00000100:00100000:0.0:1788211933.874687:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836544 00000100:00100000:0.0:1788211933.874760:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:0.0:1788211933.874772:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:14439:x1875075637836544:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788211933.874885:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:14439:x1875075637836544:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211933.874893:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00080000:3.0:1788211933.874963:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211933.883312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211933.883792:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836800 00000100:00100000:2.0:1788211933.883803:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836800 00000100:00100000:2.0:1788211933.883950:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1788211933.883964:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+12:14439:x1875075637836800:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788211933.885707:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+13:14439:x1875075637836800:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1736us (2398us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788211933.885723:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:1.0:1788211934.757505:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211934.944591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211934.944639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211934.944673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211934.944877:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637836928 00000100:00100000:1.0:1788211934.944894:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637836928 00000100:00100000:2.0:1788211934.944929:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837056 00000100:00100000:2.0:1788211934.944935:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837056 00000100:00100000:1.0:1788211934.944967:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1788211934.944973:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:2.0:1788211934.944999:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+13:2361:x1875075637837056:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211934.945006:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2361:x1875075637836928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211934.945080:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8710d9ba-217c-48be-aa23-80b8773d543b+13:2361:x1875075637837056:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211934.945088:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:0.0:1788211934.949220:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837184 00000100:00100000:0.0:1788211934.949238:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837184 00000100:00100000:0.0:1788211934.949334:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1788211934.949348:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637837184:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1788211934.949892:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211934.954158:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2361:x1875075637836928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 9143us (9561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211934.954190:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:0.0:1788211934.960644:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+5:2361:x1875075637837184:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 11287us (15990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211934.960660:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1788211934.963729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211934.963849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211934.963888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211934.963931:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837440 00000100:00100000:2.0:1788211934.963942:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837440 00000100:00100000:2.0:1788211934.964044:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:2.0:1788211934.964055:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2361:x1875075637837440:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211934.964128:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2361:x1875075637837440:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211934.964136:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00080000:0.0:1788211934.964494:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788211934.970880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211934.972393:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837312 00000100:00100000:1.0:1788211934.972407:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837312 00000100:00100000:1.0:1788211934.972666:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837568 00000100:00100000:1.0:1788211934.972670:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837568 00000100:00100000:1.0:1788211934.972706:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211934.972716:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abff6462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+5:2357:x1875075637837312:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211934.972745:0:15119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a68f6 00000100:00080000:1.0:1788211934.972761:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8abec67d5000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788211934.972773:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788211934.972778:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1788211934.972799:0:15119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1788211934.972804:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211934.973408:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abff6462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8710d9ba-217c-48be-aa23-80b8773d543b+2:2357:x1875075637837312:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 689us (9685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211934.973430:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788211934.973457:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1788211934.973465:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2357:x1875075637837568:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211934.973488:0:15119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6927 00000100:00080000:1.0:1788211934.973497:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8abec67d7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211934.973524:0:15119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788211934.973872:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+2:2357:x1875075637837568:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 407us (9982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211934.973881:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00010000:00010000:1.0:1788211934.973907:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211934.980659:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837696 00000100:00100000:1.0:1788211934.980699:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837696 00000100:00100000:2.0:1788211934.980939:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788211934.980958:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2357:x1875075637837696:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:2.0:1788211934.981011:0:15119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a692e 00000100:00080000:2.0:1788211934.981032:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8abffe067000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788211934.981080:0:15119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788211934.981332:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+2:2357:x1875075637837696:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 374us (10460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211934.981341:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00080000:0.0:1788211934.981581:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788211934.981632:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211935.781401:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788211936.541554:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788211936.541761:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:0.0:1788211936.541796:0:14474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:0.0:1788211936.541828:0:14474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:1.0:1788211936.805452:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211936.997732:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211936.997810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211936.997886:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211936.997893:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211936.997915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211936.997963:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887808 00000100:00100000:1.0:1788211936.997970:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887808 00000100:00100000:1.0:1788211936.998020:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660887936 00000100:00100000:1.0:1788211936.998023:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660887936 00000100:00100000:1.0:1788211936.998039:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788211936.998048:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660887808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211936.998084:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788211936.998131:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660887808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211936.998138:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788211936.998156:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788211936.998163:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660887936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211936.998202:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211936.998228:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660887936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211936.998233:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788211936.998268:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211936.998282:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660887808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788211936.998430:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788211936.998434:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211936.998442:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660888320:0@lo:400:kworker.0 00000100:00100000:0.0:1788211936.998486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211936.998508:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211936.998520:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660888448:0@lo:400:kworker.0 00000100:00100000:0.0:1788211936.998558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211936.998583:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888320 00000100:00100000:0.0:1788211936.998587:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888320 00000100:00100000:0.0:1788211936.998617:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888448 00000100:00100000:0.0:1788211936.998620:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888448 00000100:00100000:0.0:1788211936.998640:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788211936.998646:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211936.998683:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660888320:12345-0@lo:400:kworker.0 Request processed in 37us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211936.998689:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788211936.998702:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788211936.998708:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211936.998735:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660888448:12345-0@lo:400:kworker.0 Request processed in 27us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211936.998741:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788211936.998759:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788211936.998784:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660888448:0@lo:400:kworker.0 00000100:00100000:0.0:1788211936.998794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660888320:0@lo:400:kworker.0 00000100:00100000:1.0:1788211936.999031:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660888064:0@lo:400:kworker.0 00000100:00100000:1.0:1788211936.999083:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211936.999122:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211936.999128:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660888192:0@lo:400:kworker.0 00000100:00100000:1.0:1788211936.999149:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211936.999245:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888064 00000100:00100000:2.0:1788211936.999250:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888064 00000100:00100000:2.0:1788211936.999295:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788211936.999302:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211936.999342:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660888064:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211936.999347:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788211936.999380:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660888064:0@lo:400:kworker.0 00000100:00100000:0.0:1788211937.000656:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888192 00000100:00100000:0.0:1788211937.000691:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888192 00000100:00100000:0.0:1788211937.000745:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788211937.000754:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660888192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211937.000826:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660888192:12345-0@lo:400:kworker.0 Request processed in 73us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211937.000840:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788211937.001791:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660888192:0@lo:400:kworker.0 00000001:00100000:3.0:1788211937.083654:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00000020:00000080:3.0:1788211937.083667:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abec67d4000/8710d9ba-217c-48be-aa23-80b8773d543b 00000001:00100000:3.0:1788211937.083725:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000020:00000080:3.0:1788211937.083729:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abec67d2800/fdc55821-3eda-44a9-a166-1b5bcc681382 00000020:00000080:1.0:1788211937.083812:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec67d4000/8710d9ba-217c-48be-aa23-80b8773d543b for lustre-OST0001 00000020:00000080:1.0:1788211937.083881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec67d2800/fdc55821-3eda-44a9-a166-1b5bcc681382 for lustre-OST0001 00000020:00000080:1.0:1788211937.083904:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec67d5000 for lustre-OST0001 00000020:00000080:1.0:1788211937.083909:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abffe067000 for lustre-OST0001 00000001:00100000:3.0:1788211937.645577:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000020:00000080:3.0:1788211937.645593:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abec67d0000/fdc55821-3eda-44a9-a166-1b5bcc681382 00000020:00000080:1.0:1788211937.645948:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec67d0000/fdc55821-3eda-44a9-a166-1b5bcc681382 for lustre-OST0000 00000020:00000080:1.0:1788211937.646021:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec67d7000 for lustre-OST0000 00010000:00010000:1.0:1788211937.830067:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211938.854309:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211939.881748:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211940.058766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211940.058808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211940.058843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211940.058874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211940.058914:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837824 00000100:00100000:2.0:1788211940.058926:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837824 00000100:00100000:2.0:1788211940.058980:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 127 00000100:00100000:2.0:1788211940.058990:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2358:x1875075637837824:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211940.059075:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+13:2358:x1875075637837824:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211940.059083:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 127 00000100:00100000:2.0:1788211940.059115:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838080 00000100:00100000:2.0:1788211940.059119:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838080 00000100:00100000:2.0:1788211940.059152:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1788211940.059158:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637838080:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211940.059291:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637837952 00000100:00100000:0.0:1788211940.059296:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637837952 00000100:00100000:0.0:1788211940.059424:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838208 00000100:00100000:0.0:1788211940.059428:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838208 00000100:00100000:0.0:1788211940.059447:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788211940.059455:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:2358:x1875075637837952:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211940.059491:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:2358:x1875075637837952:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211940.059497:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788211940.059509:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1788211940.059515:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2358:x1875075637838208:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211940.059536:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2358:x1875075637838208:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211940.059541:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00080000:0.0:1788211940.059555:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788211940.059560:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788211940.060360:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8710d9ba-217c-48be-aa23-80b8773d543b+5:2358:x1875075637838080:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 1192us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211940.060373:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00010000:00010000:1.0:1788211940.901462:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211941.926001:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211942.118526:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660888576:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118633:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118682:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660889088:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118709:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118742:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788211942.118747:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660888704:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118794:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660889216:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118858:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660888832:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118906:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211942.118943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.118962:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788211942.118968:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660888960:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.118994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.119025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211942.119047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211942.119083:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888576 00000100:00100000:1.0:1788211942.119092:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888576 00000100:00100000:1.0:1788211942.119151:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788211942.119162:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660888576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119239:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660888576:12345-0@lo:400:kworker.0 Request processed in 79us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119247:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788211942.119278:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889088 00000100:00100000:1.0:1788211942.119282:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889088 00000100:00100000:1.0:1788211942.119314:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889216 00000100:00100000:1.0:1788211942.119316:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889216 00000100:00100000:1.0:1788211942.119327:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888960 00000100:00100000:1.0:1788211942.119329:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888960 00000100:00100000:1.0:1788211942.119341:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788211942.119346:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660889088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119382:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660889088:12345-0@lo:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119388:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788211942.119400:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788211942.119407:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660889216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119436:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660889216:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119449:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788211942.119463:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788211942.119468:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660888960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119504:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660888960:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119511:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788211942.119539:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888704 00000100:00100000:1.0:1788211942.119543:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888704 00000100:00100000:1.0:1788211942.119570:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660888832 00000100:00100000:1.0:1788211942.119573:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660888832 00000100:00100000:1.0:1788211942.119596:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788211942.119601:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660888704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119637:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdb90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660888704:12345-0@lo:400:kworker.0 Request processed in 35us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119643:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788211942.119656:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788211942.119662:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc4063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660888832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.119687:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc4063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660888832:12345-0@lo:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119693:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788211942.119861:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889344 00000100:00100000:1.0:1788211942.119865:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889344 00000100:00100000:1.0:1788211942.119882:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889472 00000100:00100000:1.0:1788211942.119885:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889472 00000100:00100000:1.0:1788211942.119895:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211942.119901:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211942.119944:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788211942.119978:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.119984:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211942.119996:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788211942.120003:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788211942.120021:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788211942.120048:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211942.120055:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788211942.120086:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211942.120090:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788211942.120093:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211942.120136:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660888960:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.120156:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211942.120191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660888832:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.120205:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788211942.120246:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660888704:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.120257:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660889216:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.120266:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660888576:0@lo:400:kworker.0 00000100:00100000:1.0:1788211942.120277:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffdb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660889088:0@lo:400:kworker.0 00000040:00080000:3.0:1788211942.827157:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788211942.827193:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788211942.827238:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788211942.827394:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788211942.949733:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211943.975341:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211944.998078:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211945.178683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211945.178728:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211945.178757:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211945.178800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211945.178856:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838592 00000100:00100000:1.0:1788211945.178867:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838592 00000100:00100000:3.0:1788211945.178926:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838464 00000100:00100000:3.0:1788211945.178932:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838464 00000100:00100000:1.0:1788211945.178956:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1788211945.178970:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2359:x1875075637838592:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211945.178987:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838720 00000100:00100000:3.0:1788211945.178991:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838720 00000100:00100000:3.0:1788211945.179017:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1788211945.179026:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:2359:x1875075637838464:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211945.179059:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2359:x1875075637838592:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211945.179067:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8710d9ba-217c-48be-aa23-80b8773d543b+12:2359:x1875075637838464:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211945.179073:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:3.0:1788211945.179079:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1788211945.179099:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788211945.179106:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2359:x1875075637838720:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788211945.179131:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2359:x1875075637838720:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211945.179138:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00080000:2.0:1788211945.179346:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788211945.179351:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788211945.179412:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838336 00000100:00100000:0.0:1788211945.179417:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838336 00000100:00100000:0.0:1788211945.179458:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:0.0:1788211945.179466:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637838336:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211945.179521:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637838336:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 55us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211945.179529:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00010000:00010000:2.0:1788211946.021290:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788211946.463430:0:17380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 17:32:24 (1788211944) 00010000:00010000:2.0:1788211947.052606:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211947.239796:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788211947.239830:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788211947.239919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211947.240002:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889600 00000100:00100000:3.0:1788211947.240013:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889600 00000100:00100000:3.0:1788211947.240078:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211947.240088:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660889600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788211947.240133:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211947.240212:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660889600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211947.240220:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788211947.240261:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211947.240304:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788211947.240952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660889856:0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.241080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241113:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660890368:0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.241142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788211947.241198:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889984:0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.241208:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660889728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211947.241252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241287:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889856 00000100:00100000:2.0:1788211947.241293:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889856 00000100:00100000:2.0:1788211947.241336:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788211947.241348:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660889856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.241399:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660889856:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211947.241407:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788211947.241423:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241446:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890368 00000100:00100000:2.0:1788211947.241451:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890368 00000100:00100000:0.0:1788211947.241451:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660890240:0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.241482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241496:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890240 00000100:00100000:2.0:1788211947.241500:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890240 00000100:00100000:0.0:1788211947.241507:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211947.241513:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660890112:0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.241537:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211947.241543:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788211947.241552:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660890368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.241565:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890112 00000100:00100000:0.0:1788211947.241571:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890112 00000100:00100000:2.0:1788211947.241591:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660890368:12345-0@lo:400:kworker.0 Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211947.241598:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788211947.242881:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211947.242915:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889728 00000100:00100000:1.0:1788211947.242924:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889728 00000100:00100000:1.0:1788211947.242972:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788211947.242980:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660889728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788211947.243019:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788211947.243094:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660889728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211947.243102:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788211947.243123:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211947.243211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660889728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788211947.247006:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788211947.247072:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.247240:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660890240:12345-0@lo:400:kworker.0 Request processed in 214us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211947.247472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660890240:0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.247642:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788211947.248089:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211947.248102:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211947.248187:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660890112:12345-0@lo:400:kworker.0 Request processed in 64us (6625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211947.248194:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788211947.248227:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660890112:0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.248469:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660889984 00000100:00100000:2.0:1788211947.248479:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660889984 00000100:00100000:2.0:1788211947.248592:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211947.248601:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.248651:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660889984:12345-0@lo:400:kworker.0 Request processed in 53us (7399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211947.248658:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788211947.248689:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660889984:0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.248702:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660889856:0@lo:400:kworker.0 00000100:00100000:2.0:1788211947.248736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660890368:0@lo:400:kworker.0 00010000:00010000:2.0:1788211948.069321:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211949.093502:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211950.117436:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211950.300260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211950.300306:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211950.300390:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838976 00000100:00100000:0.0:1788211950.300421:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838976 00000100:00100000:0.0:1788211950.300531:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1788211950.300544:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+12:2359:x1875075637838976:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788211950.300631:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+12:2359:x1875075637838976:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211950.300639:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00080000:2.0:1788211950.300763:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211950.300908:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637838848 00000100:00100000:1.0:1788211950.300914:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637838848 00000100:00100000:1.0:1788211950.300960:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:1.0:1788211950.300968:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637838848:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788211950.301003:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637838848:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211950.301024:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:3.0:1788211950.309135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211950.309227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211950.309281:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839232 00000100:00100000:2.0:1788211950.309293:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839232 00000100:00100000:2.0:1788211950.309381:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:2.0:1788211950.309398:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2359:x1875075637839232:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788211950.309503:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2359:x1875075637839232:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211950.309510:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00080000:1.0:1788211950.310475:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788211950.311462:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839104 00000100:00100000:1.0:1788211950.311476:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839104 00000100:00100000:1.0:1788211950.311564:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1788211950.311574:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+5:2357:x1875075637839104:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1788211950.311611:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a68ef 00000100:00080000:1.0:1788211950.311621:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abfc6400000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211950.311670:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00010000:00010000:0.0:1788211950.313871:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788211950.314447:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211950.316056:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8710d9ba-217c-48be-aa23-80b8773d543b+2:2357:x1875075637839104:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 4473us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211950.316070:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1788211951.020143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788211951.021286:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839488 00000100:00100000:1.0:1788211951.021301:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839488 00000100:00100000:1.0:1788211951.021377:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788211951.021389:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+12:15321:x1875075637839488:12345-192.168.204.29@tcp:35:umount.0 00000001:00080000:1.0:1788211951.023252:0:14440:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788211951.023360:0:14440:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1788211951.025027:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8710d9ba-217c-48be-aa23-80b8773d543b+15:15321:x1875075637839488:12345-192.168.204.29@tcp:35:umount.0 Request processed in 3617us (4875us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788211951.025046:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000020:00080000:1.0:1788211951.025058:0:14440:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788211951.034135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211951.034198:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211951.034326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788211951.045566:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839744 00000100:00100000:3.0:1788211951.045584:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839744 00000100:00100000:3.0:1788211951.045695:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839616 00000100:00100000:3.0:1788211951.045700:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839616 00000100:00100000:3.0:1788211951.045717:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637839872 00000100:00100000:3.0:1788211951.045720:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637839872 00000100:00100000:3.0:1788211951.045740:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1788211951.045750:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+15:2359:x1875075637839744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211951.045764:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211951.045783:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37ba00/0x2afbce82f55a68da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c02 expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.045820:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211951.045883:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+14:2359:x1875075637839744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 133us (11755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211951.045890:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1788211951.045910:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211951.045916:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffe6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+13:2359:x1875075637839616:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211951.045923:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211951.045933:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cde00/0x2afbce82f55a68d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd8 expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.045941:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211951.045960:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffe6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+12:2359:x1875075637839616:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 45us (11762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211951.045965:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788211951.046003:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788211951.046010:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+11:2359:x1875075637839872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788211951.046017:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211951.046026:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a6951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ca3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.046034:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211951.046050:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e558780-c9b3-4785-b2cf-98ed47205561+10:2359:x1875075637839872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 41us (11724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211951.046055:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788211951.046117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211951.046380:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637840768 00000100:00100000:0.0:1788211951.046385:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637840768 00000100:00100000:0.0:1788211951.046421:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:0.0:1788211951.046428:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+15:2357:x1875075637840768:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1788211951.046454:0:14439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a68e8 00000020:00010000:0.0:1788211951.046467:0:14439:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abec5adf000: total 0 00000100:00080000:0.0:1788211951.046472:0:14439:0:(import.c:65:import_set_state_nolock()) ffff8abfc288d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788211951.048935:0:14439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788211951.049764:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8710d9ba-217c-48be-aa23-80b8773d543b+14:2357:x1875075637840768:12345-192.168.204.29@tcp:39:umount.0 Request processed in 3327us (3637us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788211951.049777:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000020:00010000:3.0:1788211951.050111:0:15621:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abec5adf000: total 0 00010000:00010000:3.0:1788211951.050161:0:15621:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abec5adf000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788211951.050234:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:3.0:1788211951.050238:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211951.050248:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a69eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cbf expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050290:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8abfdb434400) 00010000:00010000:3.0:1788211951.050293:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788211951.050297:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a6997 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5caa expref: 12 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050323:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8abfc5bbe600) 00010000:00010000:3.0:1788211951.050326:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788211951.050330:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07000/0x2afbce82f55a6a70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ce9 expref: 11 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050353:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8abfc37ec600) 00010000:00010000:3.0:1788211951.050356:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788211951.050362:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06a00/0x2afbce82f55a6b6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d36 expref: 10 pid: 15854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050384:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434500) 00010000:00010000:3.0:1788211951.050387:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788211951.050392:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a69b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cb1 expref: 9 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050412:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:3.0:1788211951.050415:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788211951.050441:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd400/0x2afbce82f55a6aee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d13 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050463:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8abfdb434200) 00010000:00010000:3.0:1788211951.050465:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788211951.050468:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a6b11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d21 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211951.050487:0:15621:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abec5adf000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788211951.050501:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211951.050504:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211951.050505:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211951.141431:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788211951.935794:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00000001:00080000:2.0:1788211951.935818:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788211951.936005:0:5865:0:(genops.c:885:class_export_put()) final put ffff8abec5adf000/8710d9ba-217c-48be-aa23-80b8773d543b 00000020:00000080:3.0:1788211951.936098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5adf000/8710d9ba-217c-48be-aa23-80b8773d543b for lustre-MDT0000 00000020:00000080:3.0:1788211951.936227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfc288d800 for lustre-MDT0000 00000040:00080000:0.0:1788211952.037494:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788211952.037504:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211952.037538:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788211952.037546:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788211952.167416:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211952.358237:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788211952.358261:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660891008:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.358268:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660890752:0@lo:400:kworker.0 00000100:00100000:0.0:1788211952.358334:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660891136:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.358732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211952.358865:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660891264:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.358914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211952.358938:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788211952.358944:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660890880:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.358968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211952.358986:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660891392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211952.359010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211952.359045:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890752 00000100:00100000:1.0:1788211952.359054:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890752 00000100:00100000:3.0:1788211952.359109:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891264 00000100:00100000:3.0:1788211952.359114:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891264 00000100:00100000:1.0:1788211952.359213:0:15617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890880 00000100:00100000:1.0:1788211952.359217:0:15617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890880 00000100:00100000:0.0:1788211952.359338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211952.359372:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891136 00000100:00100000:0.0:1788211952.359376:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891136 00000100:00100000:2.0:1788211952.363950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211952.364029:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660890496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211952.364104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211952.364141:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660890624:0@lo:400:kworker.0 00000100:00100000:2.0:1788211952.364191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211952.365744:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891392 00000100:00100000:2.0:1788211952.365762:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891392 00000100:00100000:2.0:1788211952.365821:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890496 00000100:00100000:2.0:1788211952.365824:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890496 00000100:00100000:2.0:1788211952.365844:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211952.365856:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660891392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788211952.365914:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788211952.366329:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891008 00000100:00100000:3.0:1788211952.366335:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891008 00000100:00100000:3.0:1788211952.366551:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788211952.366561:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660891008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211952.366775:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660891008:12345-0@lo:400:kworker.0 Request processed in 214us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211952.366785:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788211952.366827:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788211952.366836:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660890752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788211952.366894:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660890752:12345-0@lo:400:kworker.0 Request processed in 60us (8163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211952.366900:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788211952.368228:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660890752:0@lo:400:kworker.0 00000100:00080000:1.0:1788211952.368276:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788211952.368281:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788211952.368284:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788211952.368327:0:15617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788211952.368336:0:15617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660890880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.368505:0:15617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875075660890880:12345-0@lo:400:kworker.0 Request processed in 171us (9535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211952.368513:0:15617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788211952.368540:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660890880:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.368584:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660890624 00000100:00100000:1.0:1788211952.368590:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660890624 00000100:00100000:1.0:1788211952.368617:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788211952.368702:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660890624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.368740:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3308:x1875075660890624:12345-0@lo:400:kworker.0 Request processed in 41us (4549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211952.368915:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788211952.368924:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660891136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788211952.368971:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660891136:12345-0@lo:400:kworker.0 Request processed in 50us (9633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211952.368976:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788211952.369020:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660891136:0@lo:400:kworker.0 00000100:00100000:0.0:1788211952.369235:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660891008:0@lo:400:kworker.0 00000100:00100000:0.0:1788211952.369249:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660890624:0@lo:400:kworker.0 00000100:00100000:1.0:1788211952.369339:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788211952.371073:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660891392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5196us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211952.371090:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211952.371128:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788211952.371143:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660890496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788211952.371318:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788211952.371953:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660890496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 813us (7844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211952.371963:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788211952.372710:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660890496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788211952.372781:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788211952.372796:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660891264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788211952.372862:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875075660891264:12345-0@lo:400:kworker.0 Request processed in 72us (13946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211952.372869:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788211952.377643:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660891392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788211952.377677:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660891264:0@lo:400:kworker.0 00000001:00100000:3.0:1788211952.986897:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8710d9ba-217c-48be-aa23-80b8773d543b 00000020:00000080:3.0:1788211952.987381:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abfc6407800/8710d9ba-217c-48be-aa23-80b8773d543b 00000020:00000080:1.0:1788211952.987453:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc6407800/8710d9ba-217c-48be-aa23-80b8773d543b for lustre-OST0000 00000020:00000080:1.0:1788211952.987513:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfc6400000 for lustre-OST0000 00010000:00010000:3.0:1788211953.189903:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211954.133152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211954.133212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211954.133247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211954.133404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788211954.133459:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841408 00000100:00100000:0.0:1788211954.133471:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841408 00000100:00100000:0.0:1788211954.133573:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:0.0:1788211954.133584:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+6:2357:x1875075637841408:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1788211954.135140:0:14437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6920 00000020:00010000:0.0:1788211954.135157:0:14437:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abec702b800: total 0 00000100:00080000:0.0:1788211954.135162:0:14437:0:(import.c:65:import_set_state_nolock()) ffff8abec7029000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788211954.135210:0:14437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1788211954.138869:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdc55821-3eda-44a9-a166-1b5bcc681382+5:2357:x1875075637841408:12345-192.168.204.29@tcp:39:umount.0 Request processed in 5258us (5436us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788211954.138887:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00080000:0.0:1788211954.138947:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788211954.139229:0:14425:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abec702b800: total 0 00010000:00010000:0.0:1788211954.139234:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211954.139274:0:14425:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abec702b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788211954.139316:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434f00) 00010000:00010000:0.0:1788211954.139320:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788211954.139329:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec6062000/0x2afbce82f55a69f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5cc6 expref: 4 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211954.139352:0:14425:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abec702b800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788211954.139363:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211954.139365:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211954.139366:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788211954.140060:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637840896 00000100:00100000:2.0:1788211954.140079:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637840896 00000100:00100000:2.0:1788211954.140154:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841152 00000100:00100000:2.0:1788211954.140158:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841152 00000100:00100000:2.0:1788211954.140199:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841024 00000100:00100000:2.0:1788211954.140202:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841024 00000100:00100000:2.0:1788211954.140223:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211954.140234:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+12:2359:x1875075637840896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211954.140253:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211954.140272:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cd600/0x2afbce82f55a690b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c3a expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211954.140289:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211954.140386:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+11:2359:x1875075637840896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 153us (7246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211954.140394:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1788211954.140423:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211954.140431:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+10:2359:x1875075637841152:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211954.140439:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211954.140449:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cd800/0x2afbce82f55a694a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c9c expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211954.140458:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211954.140768:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+9:2359:x1875075637841152:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 46us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211954.140777:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788211954.140795:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788211954.140803:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+8:2359:x1875075637841024:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788211954.140812:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211954.140843:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b200/0x2afbce82f55a6912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5c64 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211954.140863:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211954.140888:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e558780-c9b3-4785-b2cf-98ed47205561+7:2359:x1875075637841024:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 86us (7639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211954.140894:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1788211954.162919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788211954.163083:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841664 00000100:00100000:2.0:1788211954.163094:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841664 00000100:00100000:2.0:1788211954.163160:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:2.0:1788211954.163219:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+7:2357:x1875075637841664:12345-192.168.204.29@tcp:251:umount.0 00000020:00000080:2.0:1788211954.163272:0:14432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a68c5 00000020:00010000:2.0:1788211954.163284:0:14432:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abfef94b000: total 0 00000100:00080000:2.0:1788211954.163290:0:14432:0:(import.c:65:import_set_state_nolock()) ffff8abfef94a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788211954.163387:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e558780-c9b3-4785-b2cf-98ed47205561+3:2357:x1875075637841664:12345-192.168.204.29@tcp:251:umount.0 Request processed in 170us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211954.163396:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 133 00000020:00010000:3.0:1788211954.163709:0:14426:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abfef94b000: total 0 00010000:00010000:3.0:1788211954.163767:0:14426:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abfef94b000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788211954.164820:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cc200/0x2afbce82f55a68cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5bd1 expref: 2 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211954.165113:0:14426:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abfef94b000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788211954.165145:0:14426:0:(genops.c:885:class_export_put()) final put ffff8abfef94b000/4e558780-c9b3-4785-b2cf-98ed47205561 00010000:00010000:3.0:1788211954.165186:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211954.165189:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211954.165191:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788211954.165365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfef94b000/4e558780-c9b3-4785-b2cf-98ed47205561 for MGS 00000020:00000080:2.0:1788211954.165415:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfef94a800 for MGS 00010000:00010000:3.0:1788211954.213600:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211955.237904:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788211956.248306:0:17578:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:1.0:1788211956.264353:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788211956.273722:0:17578:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788211956.273776:0:17578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.273791:0:17578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.273798:0:17578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.273805:0:17578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.273869:0:17578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788211956.273876:0:17578:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788211956.273902:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211956.273906:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788211956.273912:0:17578:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788211956.273939:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abfd854e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788211956.274550:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660891520:0@lo:39:umount.0 00000100:00100000:2.0:1788211956.274637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211956.274878:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891520 00000100:00100000:0.0:1788211956.274887:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891520 00000100:00100000:0.0:1788211956.274942:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788211956.274953:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875075660891520:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788211956.274980:0:14439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6625 00000100:00080000:0.0:1788211956.274989:0:14439:0:(import.c:65:import_set_state_nolock()) ffff8abfcacbc000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788211956.277434:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211956.277450:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.277540:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abff63c6200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211956.277544:0:15621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.277555:0:15621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211956.277563:0:15621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211956.278729:0:15621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211956.278736:0:15621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788211956.278757:0:15621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788211956.279074:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875075660891520:12345-0@lo:39:umount.0 Request processed in 4117us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211956.279087:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:0.0:1788211956.279102:0:14439:0:(genops.c:885:class_export_put()) final put ffff8abfd854a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788211956.279143:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd854a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788211956.279228:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfcacbc000 for lustre-MDT0000 00000100:00080000:0.0:1788211956.279282:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfd854e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788211956.279294:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660891520:0@lo:39:umount.0 00010000:00010000:1.0:1788211956.279461:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211956.279481:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211956.279485:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788211956.279489:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788211956.280373:0:17578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280387:0:17578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280394:0:17578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280400:0:17578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280413:0:17578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788211956.280419:0:17578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280425:0:17578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280432:0:17578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280437:0:17578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280452:0:17578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788211956.280458:0:17578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280473:0:17578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280479:0:17578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280486:0:17578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280495:0:17578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788211956.280499:0:17578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280505:0:17578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280511:0:17578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280517:0:17578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211956.280523:0:17578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788211956.280527:0:17578:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788211956.280556:0:17578:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788211956.280561:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788211956.280566:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211956.280583:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788211956.280590:0:17578:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8abfcd474800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788211956.280602:0:17578:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8abfcaf31800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788211956.280611:0:17578:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8abec702b800 fdc55821-3eda-44a9-a166-1b5bcc681382 192.168.204.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788211956.280616:0:17578:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8abfca8a19b8) has exports, disconnecting them 00000020:00080000:1.0:1788211956.280621:0:17578:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8abfcd474800), last request at 1788211952 00000020:00000080:1.0:1788211956.280630:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a67e5 00000100:00080000:1.0:1788211956.280650:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abfcd476000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788211956.280702:0:17578:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfcd474800): rc 0 00000020:00000080:1.0:1788211956.280705:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfcd474800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788211956.280715:0:17578:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8abfcaf31800), last request at 1788211952 00000020:00000080:1.0:1788211956.280718:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a66aa 00000100:00080000:1.0:1788211956.280723:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abfcaf35800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788211956.280729:0:17578:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfcaf31800): rc 0 00000020:00000080:1.0:1788211956.280731:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfcaf31800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788211956.280738:0:17578:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa765c1cc3ae0 00000100:00080000:1.0:1788211956.280760:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788211956.280764:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:1.0:1788211956.280780:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788211956.280842:0:17578:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788211956.280870:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788211956.280888:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788211956.280891:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788211956.280899:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788211956.280964:0:17578:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788211956.280972:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788211956.281006:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:1.0:1788211956.281006:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8abfca8a19b8) has no exports 00010000:00010000:3.0:1788211956.281014:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281022:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211956.281026:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281035:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211956.281042:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211956.281049:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211956.281051:0:14425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788211956.281053:0:14425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788211956.281077:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281083:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788211956.281111:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281117:0:15621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281118:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37aa00/0x2afbce82f55a655a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6561 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281124:0:15621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211956.281130:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281131:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788211956.281134:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281137:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abff63c6200/0x2afbce82f55a65f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a65fb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281150:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788211956.281153:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281153:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788211956.281156:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281162:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:2.0:1788211956.281186:0:15621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281193:0:15621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211956.281200:0:15621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211956.281206:0:15621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788211956.281208:0:15621:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788211956.281210:0:15621:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788211956.281225:0:15621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281231:0:15621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211956.281247:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281253:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062400/0x2afbce82f55a6974 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a697b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211956.281275:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660892160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788211956.281347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211956.281417:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892160 00000100:00100000:2.0:1788211956.281425:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892160 00000100:00100000:2.0:1788211956.281469:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211956.281478:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3310:x1875075660892160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788211956.281491:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788211956.281508:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06800/0x2afbce82f55a697b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a6974 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281519:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788211956.281554:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05b7e8c1-59a4-46a9-9396-986dc762646c+18:3310:x1875075660892160:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211956.281561:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788211956.281583:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788211956.281590:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211956.281595:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788211956.281597:0:14425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788211956.281599:0:14425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788211956.281602:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05b7e8c1-59a4-46a9-9396-986dc762646c:3310:1875075660892160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211956.281611:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281616:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788211956.281617:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211956.281619:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281625:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b000 already unused, calling callback (ffffffffc1d37c20) 00010000:00010000:3.0:1788211956.281629:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211956.281629:0:15621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281637:0:15621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788211956.281643:0:15621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211956.281648:0:15621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788211956.281650:0:15621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788211956.281657:0:15621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788211956.281670:0:15621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281676:0:15621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788211956.281681:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281687:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b000/0x2afbce82f55a654c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6553 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211956.281698:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211956.281700:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211956.281702:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211956.281709:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abffdb80e00/0x2afbce82f55a67f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a67fa expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.281721:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211956.281723:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211956.281724:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211956.281740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660892032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788211956.281951:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211956.281977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211956.282006:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788211956.282019:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660891904:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788211956.282042:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcd474800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788211956.282045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211956.282060:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660892416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211956.282079:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788211956.282084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcaf31800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1788211956.282097:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892032 00000100:00100000:3.0:1788211956.282101:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892032 00000020:00000080:0.0:1788211956.282108:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfcd476000 for lustre-MDT0000 00000020:00000080:0.0:1788211956.282112:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfcaf35800 for lustre-MDT0000 00000100:00100000:3.0:1788211956.282121:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891904 00000100:00100000:3.0:1788211956.282124:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891904 00000100:00100000:0.0:1788211956.282132:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660891648:0@lo:9:umount.0 00000100:00100000:3.0:1788211956.282134:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892416 00000100:00100000:3.0:1788211956.282136:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892416 00000100:00100000:3.0:1788211956.282148:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788211956.282154:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+20:3309:x1875075660892032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211956.282186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788211956.282189:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211956.282200:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6063400/0x2afbce82f55a65fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a65f4 expref: 20 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211956.282208:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660891776:0@lo:9:umount.0 00010000:00010000:3.0:1788211956.282209:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211956.282228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211956.282236:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+19:3309:x1875075660892032:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211956.282242:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211956.282255:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891648 00000100:00100000:3.0:1788211956.282256:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788211956.282258:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891648 00000100:00100000:3.0:1788211956.282261:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffe6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+18:3309:x1875075660891904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211956.282268:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211956.282276:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8ccc00/0x2afbce82f55a6561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a655a expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.282284:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788211956.282288:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660891776 00000100:00100000:0.0:1788211956.282291:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660891776 00000100:00100000:3.0:1788211956.282304:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffe6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+17:3309:x1875075660891904:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211956.282316:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211956.282351:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788211956.282357:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+16:3309:x1875075660892416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211956.282365:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211956.282374:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfcb37b800/0x2afbce82f55a6553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a654c expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.282385:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211956.282407:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05b7e8c1-59a4-46a9-9396-986dc762646c+15:3309:x1875075660892416:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211956.282412:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788211956.282588:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788211956.282597:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875075660891648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788211956.282631:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a66c6 00000100:00100000:0.0:1788211956.282694:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788211956.282704:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875075660891776:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788211956.282719:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6801 00000100:00080000:0.0:1788211956.282728:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8abec5adb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788211956.282777:0:15121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788211956.283157:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1875075660891776:12345-0@lo:9:umount.0 Request processed in 455us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211956.283190:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788211956.283399:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788211956.283540:0:15120:0:(import.c:65:import_set_state_nolock()) ffff8abec5841800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788211956.283578:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788211956.283755:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660892288:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788211956.283834:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfe472f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788211956.283845:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788211956.283847:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211956.283851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660891776:0@lo:9:umount.0 00000100:00100000:3.0:1788211956.283861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211956.283907:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892288 00000100:00100000:1.0:1788211956.283948:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3307:x1875075660891648:12345-0@lo:9:umount.0 Request processed in 1353us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211956.283956:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788211956.283979:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788211956.283980:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892288 00000100:00080000:1.0:1788211956.283983:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788211956.284012:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788211956.284012:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abff600f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788211956.284019:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+15:3311:x1875075660892288:12345-0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1788211956.284021:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788211956.284022:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788211956.284025:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660891648:0@lo:9:umount.0 00010000:00010000:3.0:1788211956.284028:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788211956.284042:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cdc00/0x2afbce82f55a67fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a67f3 expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211956.284055:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788211956.284090:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05b7e8c1-59a4-46a9-9396-986dc762646c+14:3311:x1875075660892288:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211956.284096:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788211956.284132:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660891904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211956.284155:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660892416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788211956.284514:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05b7e8c1-59a4-46a9-9396-986dc762646c:3309:1875075660892032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211956.284538:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211956.285492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660892288:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788211956.294276:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8abfca8a19b8) has no exports 00000020:00000080:0.0:1788211956.365902:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65a7 00000020:00000080:0.0:1788211956.365924:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfefb1d000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788211956.366008:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788211956.366942:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211956.366959:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211956.366964:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8abfca8a3370) has no exports 00000020:00000080:0.0:1788211956.367371:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65a0 00000020:00000080:0.0:1788211956.367383:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfca9d7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788211956.369565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb1d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788211956.372018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfca9d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788211956.372041:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788211956.372056:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788211956.372062:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfca9d1800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788211956.372066:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfca9d1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788211956.372072:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:0.0:1788211957.056795:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdc55821-3eda-44a9-a166-1b5bcc681382 00000001:00080000:0.0:1788211957.056823:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788211957.056830:0:5865:0:(genops.c:885:class_export_put()) final put ffff8abec702b800/fdc55821-3eda-44a9-a166-1b5bcc681382 00000020:00000080:3.0:1788211957.059081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec702b800/fdc55821-3eda-44a9-a166-1b5bcc681382 for lustre-MDT0000 00000020:00000080:3.0:1788211957.059244:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec7029000 for lustre-MDT0000 00010000:00010000:0.0:1788211957.285436:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211957.477434:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788211957.477456:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660892544:0@lo:400:kworker.0 00000100:00100000:1.0:1788211957.477531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211957.477610:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660892672:0@lo:400:kworker.0 00000100:00100000:1.0:1788211957.477638:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211957.477658:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788211957.477664:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660892800:0@lo:400:kworker.0 00000100:00100000:1.0:1788211957.477685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211957.478062:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892544 00000100:00100000:1.0:1788211957.478072:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892544 00000100:00100000:1.0:1788211957.478127:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788211957.478137:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+14:3308:x1875075660892544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211957.478215:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffdbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05b7e8c1-59a4-46a9-9396-986dc762646c+14:3308:x1875075660892544:12345-0@lo:400:kworker.0 Request processed in 79us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211957.478235:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788211957.478287:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660892544:0@lo:400:kworker.0 00000100:00100000:0.0:1788211957.479802:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892672 00000100:00100000:0.0:1788211957.479817:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892672 00000100:00100000:0.0:1788211957.479861:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892800 00000100:00100000:0.0:1788211957.479864:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892800 00000100:00100000:0.0:1788211957.479887:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788211957.479907:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875075660892672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788211957.479917:0:14437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788211957.480000:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875075660892672:12345-0@lo:400:kworker.0 Request processed in 104us (2360us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788211957.480007:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788211957.480022:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788211957.480026:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875075660892800:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788211957.480030:0:14437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788211957.480064:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875075660892800:12345-0@lo:400:kworker.0 Request processed in 36us (2378us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788211957.480069:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788211957.485539:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788211957.485560:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788211957.485566:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788211957.519720:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211957.519736:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 490 00000100:00080000:1.0:1788211957.519748:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec7028800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211957.519798:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001240380 x1875075660892928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211957.519832:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875075660892800:0@lo:400:kworker.0 00000100:00080000:1.0:1788211957.519869:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788211957.519874:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8abec53e4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788211957.519878:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788211957.519882:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8abec53e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211957.519885:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 475 00000100:00080000:1.0:1788211957.519890:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8abec53e4000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211957.519903:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001243100 x1875075660893056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211957.519914:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660892672:0@lo:400:kworker.0 00000100:00100000:0.0:1788211957.520668:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660892928:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788211957.520757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211957.520807:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660893056:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788211957.520830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211957.520886:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660892928 00000100:00100000:0.0:1788211957.520893:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660892928 00000100:00100000:0.0:1788211957.520926:0:15854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893056 00000100:00100000:0.0:1788211957.520929:0:15854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893056 00000100:00100000:0.0:1788211957.520948:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788211957.520957:0:15854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875075660892928:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788211957.521197:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788211957.521205:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660893056:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788211957.522122:0:15854:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:2.0:1788211957.526320:0:14437:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788211957.526460:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660893056:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 5250us (5624us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788211957.526474:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788211957.526917:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec53e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788211957.526924:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788211957.526931:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660893056:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788211957.539383:0:15854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875075660892928:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 18414us (18614us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788211957.539423:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788211957.539811:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788211957.539818:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788211957.539822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660892928:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:2.0:1788211957.557912:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788211957.557924:0:7655:0:(genops.c:885:class_export_put()) final put ffff8abec5ada000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211957.557978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5ada000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788211957.558033:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec5adb000 for lustre-OST0001 00000001:00100000:2.0:1788211958.055566:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788211958.055595:0:6720:0:(genops.c:885:class_export_put()) final put ffff8abec5842000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788211958.056278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5842000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788211958.056340:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec5841800 for lustre-OST0000 00010000:00010000:2.0:1788211958.309353:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788211958.442586:0:17578:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc8c58960 - data ffff8abffade9510/ffff8abec6bd1000 00000020:01000000:2.0:1788211958.442760:0:17578:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abff7039a80 - data ffff8abfda286000/ffff8abfc45fb400 00000001:00000004:2.0:1788211958.455634:0:17578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1788211958.575960:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788211958.575972:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:0.0:1788211958.576001:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211958.576006:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788211958.576995:0:14459:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788211958.577004:0:14459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788211958.577019:0:14459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788211958.578143:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788211958.578152:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788211958.578204:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211958.578208:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788211958.578812:0:14461:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788211958.578818:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1788211958.578829:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788211958.675342:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a656f 00000020:00000080:0.0:1788211958.675358:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abff6008000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788211958.676578:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6584 00000020:00000080:0.0:1788211958.676588:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfefb0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211958.677410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abff6008000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788211958.677520:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788211958.677538:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.677547:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211958.677552:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8abfca8a4d28) has no exports 00000004:01000000:0.0:1788211958.677734:0:17578:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788211958.677744:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65d1 00000020:00000080:0.0:1788211958.677751:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfc8638800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788211958.677757:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788211958.677761:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.677766:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788211958.677768:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8abfca8b99b8) has no exports 00000020:00000080:0.0:1788211958.677776:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65ca 00000020:00000080:0.0:1788211958.677779:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfe4728000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788211958.678073:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb0d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788211958.678081:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc8638800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788211958.678087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfe4728000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788211958.678390:0:17578:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788211958.678396:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788211958.678400:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788211958.678407:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211958.678409:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211958.678452:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.678459:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211958.678466:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65bc 00000020:00000080:0.0:1788211958.678472:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfe472c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788211958.678477:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788211958.678481:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.678485:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788211958.678488:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8abfd83619b8) has no exports 00000020:00000080:0.0:1788211958.678493:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a65b5 00000020:00000080:0.0:1788211958.678496:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfefb0a000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788211958.678886:0:17578:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788211958.678890:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788211958.678892:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788211958.678896:0:17578:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788211958.678898:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211958.678924:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.678928:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211958.679072:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfe472f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788211958.679082:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfe472a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211958.679085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfe472a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788211958.679090:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788211958.679221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfe472c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788211958.679227:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788211958.679232:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abff600f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788211958.679236:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfefb19800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788211958.679238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb19800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788211958.679242:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211958.679861:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.679869:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211958.679873:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abff600e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788211958.679875:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8abff600e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788211958.679885:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788211958.680103:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a658b 00000020:00000080:0.0:1788211958.680110:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfefb0c800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788211958.680703:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788211958.680712:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.680734:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211958.680739:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8abfca8a0000) has no exports 00000020:00000080:0.0:1788211958.680780:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.680784:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788211958.680791:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6592 00000020:00000080:0.0:1788211958.680798:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfefb0a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788211958.680840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb0c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788211958.680845:0:8:0:(genops.c:885:class_export_put()) final put ffff8abfefb09800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788211958.680848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb09800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788211958.680853:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788211958.681463:0:17578:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac00108a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788211958.681468:0:17578:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac00108a000 3 00000020:01000004:0.0:1788211958.681471:0:17578:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac00108a000 from lustre-MDT0000 00000020:00000080:0.0:1788211958.681493:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.681498:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788211958.681502:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abff600b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788211958.681504:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8abff600b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788211958.681515:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788211958.681562:0:17578:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788211958.681566:0:17578:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788211958.681569:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788211958.681572:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.681575:0:17578:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788211958.681583:0:17578:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8abfc542f800 05b7e8c1-59a4-46a9-9396-986dc762646c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788211958.681589:0:17578:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8abfca8b8000) has exports, disconnecting them 00000020:00080000:0.0:1788211958.681595:0:17578:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8abfc542f800), last request at 1788211870 00000020:00000080:0.0:1788211958.681612:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6530 00000020:00010000:0.0:1788211958.681616:0:17578:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8abfc542f800: total 1 00000100:00080000:0.0:1788211958.681620:0:17578:0:(import.c:65:import_set_state_nolock()) ffff8abfc542b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788211958.681673:0:17578:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfc542f800): rc 0 00000020:00080000:0.0:1788211958.681677:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8abfca8b8000) has no exports 00000100:00100000:0.0:1788211958.681730:0:14431:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8abfc6526000:14431] 1 exiting: rc = 0 00000020:00010000:3.0:1788211958.681838:0:14425:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8abfc542f800: total 1 00010000:00010000:3.0:1788211958.681873:0:14425:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8abfc542f800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788211958.681902:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb81200/0x2afbce82f55a67a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a679f expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.681918:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062800/0x2afbce82f55a6695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a668e expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.681928:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cca00/0x2afbce82f55a6545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a653e expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.681965:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06600/0x2afbce82f55a695f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a6958 expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.681977:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062a00/0x2afbce82f55a696d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a6966 expref: 5 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.681992:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec6062200/0x2afbce82f55a67d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a67c9 expref: 4 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.682002:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfca8cce00/0x2afbce82f55a666b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a6664 expref: 3 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.682015:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abff63c7200/0x2afbce82f55a665d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2afbce82f55a6656 expref: 2 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211958.682027:0:14425:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8abfc542f800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788211958.682041:0:14425:0:(genops.c:885:class_export_put()) final put ffff8abfc542f800/05b7e8c1-59a4-46a9-9396-986dc762646c 00010000:00010000:3.0:1788211958.682047:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211958.682049:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211958.682050:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788211958.682196:0:14430:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8abfd0b09200:14430] 0 exiting: rc = 1 00000020:00000080:1.0:1788211958.682247:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfefb0a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788211958.682261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc542f800/05b7e8c1-59a4-46a9-9396-986dc762646c for MGS 00000020:00000080:1.0:1788211958.682289:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfc542b800 for MGS 00000100:00100000:0.0:1788211958.682365:0:14432:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8abfffdbea00:14432] 2 exiting: rc = 0 00000100:00100000:1.0:1788211958.682463:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682472:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682478:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682484:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682490:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682504:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682510:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682515:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682521:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682540:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682546:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682551:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682556:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682561:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682567:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682572:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682578:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682582:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682588:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682593:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682598:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682605:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682611:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682616:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682622:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682628:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682633:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682638:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682644:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682650:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682655:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682660:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682673:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682678:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682683:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682687:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682693:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682698:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682705:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682710:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682715:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682720:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682726:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682731:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682737:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682742:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682747:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682752:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682757:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682762:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682767:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682773:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682778:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682783:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682788:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682794:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682800:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682805:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682809:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682814:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682819:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682824:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682830:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211958.682836:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788211958.683845:0:17578:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788211958.683853:0:17578:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788211958.684955:0:17578:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc8c58b40 - data ffff8abffafe1870/ffff8abec5812000 00000020:01000000:1.0:1788211958.685099:0:17578:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc58d5000 - data ffff8abfee7bfd80/ffff8abfcafbb800 00000020:00000080:1.0:1788211958.685668:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a651b 00000020:00000080:1.0:1788211958.685679:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfc59c2000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788211958.685696:0:17578:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac00108a000 from MGS, refs=2 00000020:01000004:1.0:1788211958.685700:0:17578:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac00108a000 2 00000020:01000004:1.0:1788211958.685704:0:17578:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac00108a000 from MGS 00000020:00000080:1.0:1788211958.685734:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211958.685743:0:17578:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788211958.685746:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfc59c1800/MGS 00000020:00000080:1.0:1788211958.685749:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc59c1800/MGS for MGS 00000020:01000000:1.0:1788211958.685759:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788211958.685826:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788211958.685830:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211958.685836:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788211958.685844:0:17578:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8abfd854d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788211958.685850:0:17578:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff8abfd8364d28) has exports, disconnecting them 00000020:00080000:1.0:1788211958.685855:0:17578:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8abfd854d800), last request at 1788211870 00000020:00000080:1.0:1788211958.685859:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6609 00000020:00080000:1.0:1788211958.685869:0:17578:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abfd854d800): rc 0 00000020:00000080:1.0:1788211958.685873:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfd854d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788211958.688235:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc59c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788211958.688271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd854d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788211958.689243:0:17578:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788211958.689249:0:17578:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788211958.689265:0:17578:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788211958.689272:0:17578:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211958.689473:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.689482:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788211958.689490:0:17578:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ac00108a000 1 00000020:00000080:0.0:1788211958.689497:0:17578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a650d 00000020:00000080:0.0:1788211958.689505:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abfc59c7000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788211958.689510:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788211958.689516:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211958.689534:0:17578:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211958.689539:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8abff7023370) has no exports 00000020:00000080:3.0:1788211958.689795:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abfd854e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788211958.689804:0:36:0:(genops.c:885:class_export_put()) final put ffff8abfd854f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788211958.689807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfd854f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788211958.689813:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788211958.689887:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc59c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788211958.705905:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788211958.705933:0:17578:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788211958.705949:0:17578:0:(genops.c:885:class_export_put()) final put ffff8ac001089800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788211958.705955:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8ac001089800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788211958.705963:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788211958.706136:0:17578:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ac00108d800 00000020:01000000:3.0:1788211958.706196:0:17578:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788211958.706201:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788211958.706206:0:17578:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788211958.706211:0:17578:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8abff70219b8) has no exports 00000100:00100000:2.0:1788211958.709463:0:14437:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8abffe2dec00:14437] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.712917:0:14438:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8abfc921c800:14438] 1 exiting: rc = 0 00000100:00100000:0.0:1788211958.713084:0:14439:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ac001125600:14439] 2 exiting: rc = 0 00000100:00100000:0.0:1788211958.739423:0:15854:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8abfca8e6200:15854] 3 exiting: rc = 0 00000100:00100000:3.0:1788211958.739694:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739705:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739711:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739717:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739739:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739745:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739751:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739758:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739764:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739773:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739778:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739797:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739802:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739808:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739814:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739821:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739826:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739832:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739837:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739843:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739849:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739855:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739863:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739868:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739874:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739903:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739909:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739914:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739919:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739924:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739931:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739936:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739947:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739955:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739961:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739967:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739973:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739979:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739986:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739994:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.739999:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740005:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740010:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740019:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740026:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740031:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740037:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740043:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740049:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740055:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740061:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740067:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740074:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740080:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740086:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740092:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740097:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740102:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740107:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740113:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740127:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740133:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740139:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.740144:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.748406:0:14440:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8abfffdbf600:14440] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.748596:0:14441:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8abfef8ede00:14441] 1 exiting: rc = 0 00000100:00100000:3.0:1788211958.748710:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748721:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748735:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748741:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748747:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748754:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748759:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748765:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748770:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748776:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748785:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748790:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748797:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748802:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748807:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748814:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748819:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748825:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748831:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748838:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748845:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748852:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748857:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748863:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748869:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748874:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748880:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748885:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748891:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748897:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748902:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748929:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748934:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748946:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748955:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748960:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748965:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748971:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748976:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748980:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748986:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748991:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.748997:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749001:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749006:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749011:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749015:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749020:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749025:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749029:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749034:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749039:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749044:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749049:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749066:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749072:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749078:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749084:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749090:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749096:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749101:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749107:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749113:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.749119:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.751985:0:14442:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8abfe4b8d000:14442] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.752229:0:14443:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8abfd2b3ac00:14443] 1 exiting: rc = 0 00000100:00100000:3.0:1788211958.752362:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752371:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752395:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752402:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752410:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752424:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752431:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752437:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752443:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752450:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752456:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752462:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752469:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752475:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752481:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752487:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752492:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752514:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752534:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752541:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752548:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752555:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752562:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752568:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752575:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752582:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752588:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752594:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752600:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752625:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752634:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752655:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752664:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752671:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752679:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752686:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752692:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752709:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752715:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752722:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752728:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752751:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752760:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752766:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752771:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752778:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752784:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752791:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752797:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752804:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752810:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752817:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752823:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752846:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752853:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752858:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752865:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752870:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752877:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752888:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752894:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752902:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752908:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.752915:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780616:0:14444:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8abfd2b3be00:14444] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.780774:0:14445:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8abfefb05c00:14445] 1 exiting: rc = 0 00000100:00100000:0.0:1788211958.780832:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780839:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780845:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780851:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780857:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780862:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780866:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780871:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780876:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780880:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780886:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780891:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780914:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780919:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780925:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780930:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.780934:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781270:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781280:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781285:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781291:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781297:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781301:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781307:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781311:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781317:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781321:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781326:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781331:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781336:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781341:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781345:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781349:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781354:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781359:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781364:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781369:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781374:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781379:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781384:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781389:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781394:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781398:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781403:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781407:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781412:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781416:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781430:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781434:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781440:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781445:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781449:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781454:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781458:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781463:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781468:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781472:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781476:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781480:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781484:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781489:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781493:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781498:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781502:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.781805:0:14447:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8abfefb04800:14447] 1 exiting: rc = 0 00000100:00100000:2.0:1788211958.782099:0:14446:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8abfefb05600:14446] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.785684:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785694:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785700:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785706:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785711:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785715:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785720:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785732:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785740:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785753:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785758:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785762:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785770:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785776:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785781:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785786:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785790:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785805:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785810:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785815:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785820:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785825:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785830:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785835:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785840:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785844:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785849:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785854:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785858:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785862:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785867:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785874:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785880:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785885:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785889:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785893:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785897:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785903:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785908:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785912:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785917:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785922:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785926:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785931:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785936:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785941:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785946:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785952:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785957:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785962:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785967:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785972:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785984:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785990:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.785996:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786004:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786008:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786014:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786018:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786024:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786028:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786033:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786039:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.786044:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.788332:0:14448:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8abfefb05e00:14448] 0 exiting: rc = 1 00000100:00100000:3.0:1788211958.788575:0:14449:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8abfefb05200:14449] 1 exiting: rc = 0 00000100:00100000:0.0:1788211958.789688:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789697:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789703:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789709:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789716:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789722:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789727:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789732:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789737:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789755:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789762:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789767:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789772:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789777:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789782:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789788:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789793:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789797:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789802:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789807:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789811:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789817:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789839:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789844:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789849:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789856:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789861:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789868:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789873:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789879:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789886:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789892:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789897:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789902:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789908:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789913:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789919:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789924:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789929:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789933:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789938:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789944:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789950:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789955:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789961:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789965:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789970:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789974:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789979:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789985:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789990:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.789995:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790000:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790007:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790012:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790017:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790021:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790033:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790038:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790043:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790048:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790053:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790058:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.790064:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211958.790767:0:14450:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8abfefb05a00:14450] 0 exiting: rc = 1 00000100:00100000:0.0:1788211958.791539:0:14451:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8abfefb04400:14451] 1 exiting: rc = 0 00000100:00100000:0.0:1788211958.793313:0:14452:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8abfc1378c00:14452] 2 exiting: rc = 0 00000100:00100000:0.0:1788211958.793452:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793460:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793466:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793471:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793477:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793482:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793513:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793531:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793537:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793543:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793548:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793554:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793560:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793565:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793571:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793577:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793582:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793588:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793595:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793601:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793607:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793613:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793619:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793625:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793631:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793636:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793661:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793666:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793672:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793677:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793697:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793704:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793710:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793716:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793721:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793726:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793731:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.793737:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.796881:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.796906:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.796911:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.796917:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.796922:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797032:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797041:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797047:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797054:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797064:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797070:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797080:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797086:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797091:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797097:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797104:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797130:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797137:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797153:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797162:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797184:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797189:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797195:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797213:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797218:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211958.797223:0:17578:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788211958.812310:0:17578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211958.812325:0:17578:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788211958.812331:0:17578:0:(genops.c:885:class_export_put()) final put ffff8abec587a800/MDS_uuid 00000020:00000080:0.0:1788211958.812336:0:17578:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec587a800/MDS_uuid for MDS 00000020:01000000:0.0:1788211958.812343:0:17578:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788211958.812465:0:17578:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788211959.334254:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211960.359792:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211961.382333:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788211961.988795:0:17731:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788211962.000346:0:17731:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788211962.000406:0:17731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.000422:0:17731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.000430:0:17731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.000437:0:17731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.000473:0:17731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788211962.000481:0:17731:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788211962.000504:0:17731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788211962.000510:0:17731:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788211962.000518:0:17731:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788211962.000524:0:17731:0:(import.c:65:import_set_state_nolock()) ffff8abec53e4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788211962.000530:0:17731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788211962.000531:0:17731:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788211962.000534:0:17731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788211962.001372:0:17731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001384:0:17731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001391:0:17731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001397:0:17731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001416:0:17731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788211962.001424:0:17731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001431:0:17731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001436:0:17731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001442:0:17731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211962.001455:0:17731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788211962.001469:0:17731:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788211962.001494:0:17731:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788211962.001500:0:17731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788211962.001504:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211962.001512:0:17731:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788211962.001527:0:17731:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8abfca8bb370) has no exports 00000020:00080000:2.0:1788211962.001559:0:17731:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8abfca8bb370) has no exports 00010000:00010000:0.0:1788211962.003104:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788211962.003117:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003127:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211962.003132:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003141:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211962.003150:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211962.003155:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788211962.003158:0:14426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788211962.003161:0:14426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788211962.003224:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003231:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211962.003262:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003285:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062600/0x2afbce82f55a668e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a6695 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003299:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788211962.003302:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003308:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211962.003311:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003317:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211962.003323:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211962.003328:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788211962.003330:0:14426:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788211962.003332:0:14426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788211962.003344:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003349:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211962.003354:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003360:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063200/0x2afbce82f55a6664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a666b expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003380:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211962.003383:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003389:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211962.003392:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003398:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211962.003405:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211962.003410:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788211962.003413:0:14426:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788211962.003415:0:14426:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788211962.003429:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003434:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211962.003451:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003457:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6062e00/0x2afbce82f55a6966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2afbce82f55a696d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211962.003478:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211962.003479:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211962.003485:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211962.003510:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660893184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211962.003600:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211962.003670:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788211962.003676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660893312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211962.003698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211962.003728:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788211962.003736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660893440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211962.003759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788211962.003864:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211962.003947:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788211962.003962:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893184 00000100:00100000:3.0:1788211962.003969:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893184 00000100:00100000:3.0:1788211962.004004:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893312 00000100:00100000:3.0:1788211962.004007:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893312 00000100:00100000:3.0:1788211962.004024:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893440 00000100:00100000:3.0:1788211962.004027:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893440 00000100:00100000:3.0:1788211962.004040:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788211962.004047:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875075660893184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788211962.004054:0:14423:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788211962 with bad export cookie 3097296230604760368 00000020:01000000:2.0:1788211962.010321:0:17731:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc8c58d20 - data ffff8abff1b0f510/ffff8abec6e37c00 00000020:01000000:2.0:1788211962.010518:0:17731:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc83a92a0 - data ffff8abfc21cd798/ffff8abec6d68800 00000100:00100000:3.0:1788211962.015736:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875075660893184:12345-0@lo:103:ldlm_bl.0 Request processed in 11679us (12127us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788211962.015752:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788211962.015824:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788211962.015829:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788211962.015833:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788211962.018846:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211962.018863:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875075660893312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788211962.018874:0:14424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788211962 with bad export cookie 3097296230604760368 00000100:00100000:2.0:1788211962.018989:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1875075660893312:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (15288us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788211962.018997:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211962.019028:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788211962.019032:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875075660893440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788211962.019037:0:14424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788211962 with bad export cookie 3097296230604760368 00000100:00100000:2.0:1788211962.019091:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1875075660893440:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (15330us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788211962.019096:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788211962.019616:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788211962.026303:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.129@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788211962.026308:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788211962.026318:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abffde64e00 x1875075660893184/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788211977 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211962.026331:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abffde66d80 x1875075660893312/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788211977 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211962.026365:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8abffde66300 x1875075660893440/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788211977 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788211962.026480:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8abec587e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788211962.026504:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05b7e8c1-59a4-46a9-9396-986dc762646c:3311:1875075660893440:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788211962.026583:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788211962.026586:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788211962.026588:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788211962.026591:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788211962.026596:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1788211962.026604:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211962.026643:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001241f80 x1875075660893568/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211962.026708:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660893312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788211962.026714:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05b7e8c1-59a4-46a9-9396-986dc762646c:3308:1875075660893184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211962.026778:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05b7e8c1-59a4-46a9-9396-986dc762646c:3307:1875075660893568:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788211962.026830:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875075660893568 offset 0 length 520: 4 00100000:10000000:2.0:1788211962.033342:0:17731:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788211962.062050:0:17731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6679 00000020:00000080:2.0:1788211962.062061:0:17731:0:(genops.c:885:class_export_put()) final put ffff8abfcaf32000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788211962.062082:0:17731:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abec584a000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788211962.062086:0:17731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abec584a000 2 00000020:01000004:2.0:1788211962.062090:0:17731:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8abec584a000 from lustre-OST0000 00000020:00000080:2.0:1788211962.062115:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788211962.062310:0:17731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788211962.062314:0:17731:0:(genops.c:885:class_export_put()) final put ffff8abfdb0c8000/lustre-OST0000_UUID 00000020:00000080:2.0:1788211962.062318:0:17731:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfdb0c8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788211962.062324:0:17731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788211962.062375:0:17731:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788211962.062388:0:17731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788211962.062391:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211962.062396:0:17731:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788211962.062403:0:17731:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8abec53e7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788211962.062409:0:17731:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8abfca8bcd28) has exports, disconnecting them 00000020:00080000:2.0:1788211962.062414:0:17731:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8abec53e7000), last request at 1788211885 00000020:00000080:2.0:1788211962.062419:0:17731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a66a3 00000020:00080000:2.0:1788211962.062428:0:17731:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abec53e7000): rc 0 00000020:00000080:2.0:1788211962.062432:0:17731:0:(genops.c:885:class_export_put()) final put ffff8abec53e7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788211962.063360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfcaf32000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788211962.063380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec53e7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788211962.067390:0:17731:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788211962.067402:0:17731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788211962.067407:0:17731:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788211962.067418:0:17731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788211962.067639:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211962.067653:0:17731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788211962.067661:0:17731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abec584a000 1 00000020:00000080:0.0:1788211962.067671:0:17731:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6648 00000020:00000080:0.0:1788211962.067685:0:17731:0:(genops.c:885:class_export_put()) final put ffff8abfc6404800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788211962.067691:0:17731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788211962.067698:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211962.067703:0:17731:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788211962.067707:0:17731:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8abff7024d28) has no exports 00000020:00000080:1.0:1788211962.068426:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec53e4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788211962.068436:0:8:0:(genops.c:885:class_export_put()) final put ffff8abec53e3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788211962.068441:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec53e3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788211962.068450:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788211962.068536:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc6404800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788211962.090282:0:17731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788211962.090301:0:17731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788211962.090307:0:17731:0:(genops.c:885:class_export_put()) final put ffff8abec584e800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788211962.090314:0:17731:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec584e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788211962.090325:0:17731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788211962.090483:0:17731:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8abec584f000 00000020:02000400:1.0:1788211962.090526:0:17731:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788211962.406710:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788211962.601483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788211962.601499:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788211962.601505:0:8:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788211962.601515:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 546 00000100:00080000:2.0:1788211962.601523:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788211962.601531:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec7028800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211962.601581:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001203100 x1875075660893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211962.601822:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660893696:0@lo:38:kworker.0 00000400:00000100:1.0:1788211962.601914:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875075660893696 offset 0 length 520: 4 00010000:00010000:1.0:1788211963.441505:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211964.453387:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788211965.079733:0:17880:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788211965.087895:0:17880:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788211965.087998:0:17880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.088013:0:17880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.088021:0:17880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.088029:0:17880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.088056:0:17880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788211965.088063:0:17880:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788211965.088088:0:17880:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211965.088103:0:17880:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001203100 x1875075660893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788211977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788211965.088120:0:17880:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788211965.088163:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788211965.088196:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1788211965.088200:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660893696:0@lo:38:kworker.0 00000100:00080000:1.0:1788211965.088238:0:17880:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788211965.088245:0:17880:0:(import.c:65:import_set_state_nolock()) ffff8abec7028800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788211965.088251:0:17880:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788211965.088270:0:17880:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788211965.088274:0:17880:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788211965.089256:0:17880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089271:0:17880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089278:0:17880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089284:0:17880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089305:0:17880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788211965.089323:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788211965.089330:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089338:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211965.089343:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089353:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211965.089362:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211965.089368:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788211965.089371:0:14425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788211965.089385:0:14425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788211965.089420:0:14425:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abec587e800 00010000:00010000:1.0:1788211965.089426:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089434:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37ae00/0x2afbce82f55a67c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a67d0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089451:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788211965.089455:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089461:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788211965.089463:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089469:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788211965.089475:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211965.089480:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788211965.089482:0:14425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788211965.089486:0:14425:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abec587e800 00010000:00010000:1.0:1788211965.089488:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089493:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a679f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a67a6 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089512:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211965.089513:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211965.089516:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211965.089531:0:17880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089539:0:17880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089545:0:17880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089551:0:17880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211965.089575:0:17880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788211965.089579:0:17880:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788211965.089583:0:17880:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788211965.089606:0:17880:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788211965.089611:0:17880:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788211965.089618:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788211965.089625:0:17880:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788211965.089630:0:17880:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8abfd2a9cd28) has no exports 00000020:00080000:1.0:1788211965.089669:0:17880:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8abfd2a9cd28) has no exports 00010000:00010000:0.0:1788211965.090460:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211965.090467:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211965.090476:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cda00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211965.090479:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211965.090487:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211965.090494:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211965.090500:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788211965.090502:0:14426:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788211965.090504:0:14426:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788211965.090517:0:14426:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abec587e800 00010000:00010000:0.0:1788211965.090521:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211965.090528:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfca8cda00/0x2afbce82f55a6958 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a695f expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211965.090545:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211965.090547:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211965.090548:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788211965.090853:0:15621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788211965.097151:0:17880:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfc8c58120 - data ffff8abffaf71bd0/ffff8abec66e6000 00000020:01000000:1.0:1788211965.097355:0:17880:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8abfe46a1ba0 - data ffff8abffadce288/ffff8abec7b43800 00100000:10000000:1.0:1788211965.103639:0:17880:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788211965.125064:0:17880:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a67b4 00000020:00000080:0.0:1788211965.125075:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec53e5000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788211965.125093:0:17880:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfef94e000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788211965.125109:0:17880:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfef94e000 2 00000020:01000004:0.0:1788211965.125113:0:17880:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8abfef94e000 from lustre-OST0001 00000020:00000080:0.0:1788211965.125137:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211965.125146:0:17880:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788211965.125149:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec53e5800/lustre-OST0001_UUID 00000020:00000080:0.0:1788211965.125152:0:17880:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec53e5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788211965.125158:0:17880:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788211965.125386:0:17880:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 05b7e8c1-59a4-46a9-9396-986dc762646c->MGS 00010000:00010000:0.0:1788211965.125415:0:17880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211965.125428:0:17880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211965.125435:0:17880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788211965.125438:0:17880:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788211965.125441:0:17880:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788211965.125459:0:17880:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abec587e800 00010000:00010000:0.0:1788211965.125464:0:17880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abec6063e00/0x2afbce82f55a6656 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a665d expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211965.125479:0:17880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211965.125485:0:17880:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211965.125490:0:17880:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788211965.125492:0:17880:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788211965.125494:0:17880:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788211965.125503:0:17880:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8abec587e800 00010000:00010000:0.0:1788211965.125506:0:17880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfcb37b400/0x2afbce82f55a653e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2afbce82f55a6545 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788211965.125533:0:17880:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788211965.125537:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788211965.125540:0:17880:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788211965.125541:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788211965.125545:0:17880:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788211965.125560:0:17880:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac001241f80 x1875075660893568/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788211972 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788211965.125585:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788211965.125589:0:17880:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788211965.125782:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05b7e8c1-59a4-46a9-9396-986dc762646c:3307:1875075660893568:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788211965.126417:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788211965.126430:0:17880:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6529 00000020:00000080:0.0:1788211965.126439:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec587a000/05b7e8c1-59a4-46a9-9396-986dc762646c 00000020:01000000:0.0:1788211965.126449:0:17880:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.129@tcp (flags='') 00000020:00000080:0.0:1788211965.126458:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211965.126467:0:17880:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788211965.126472:0:17880:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8abff7020000) has no exports 00000020:00000080:3.0:1788211965.126564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec53e5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788211965.126583:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec587a000/05b7e8c1-59a4-46a9-9396-986dc762646c for MGC192.168.204.129@tcp 10000000:01000000:2.0:1788211965.126690:0:14434:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788211965.126792:0:17880:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.129@tcp: client import never connected 00000100:00080000:0.0:1788211965.126796:0:17880:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788211965.126799:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788211965.126802:0:17880:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788211965.126803:0:17880:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788211965.126894:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211965.126901:0:17880:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.129@tcp (uuid 05b7e8c1-59a4-46a9-9396-986dc762646c) 00000020:01000000:0.0:1788211965.126909:0:17880:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788211965.126912:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211965.126916:0:17880:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788211965.126921:0:17880:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8abec702a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788211965.126927:0:17880:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff8abec66f19b8) has exports, disconnecting them 00000020:00080000:0.0:1788211965.126931:0:17880:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8abec702a800), last request at 1788211901 00000020:00000080:0.0:1788211965.126935:0:17880:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a67de 00000020:00080000:0.0:1788211965.126961:0:17880:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8abec702a800): rc 0 00000020:00000080:0.0:1788211965.126965:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec702a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788211965.128942:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec587e800 for MGC192.168.204.129@tcp 00000020:00000080:3.0:1788211965.128965:0:8:0:(genops.c:885:class_export_put()) final put ffff8abec5879000/05b7e8c1-59a4-46a9-9396-986dc762646c 00000020:00000080:3.0:1788211965.128969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec5879000/05b7e8c1-59a4-46a9-9396-986dc762646c for MGC192.168.204.129@tcp 00000020:01000000:3.0:1788211965.128981:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.129@tcp (05b7e8c1-59a4-46a9-9396-986dc762646c) 00000020:00000080:3.0:1788211965.132690:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec702a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788211965.137619:0:17880:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788211965.137631:0:17880:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788211965.137635:0:17880:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788211965.137643:0:17880:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788211965.137813:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8abec7028800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788211965.137937:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788211965.138055:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788211965.138526:0:15621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788211965.138881:0:14421:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ac001125a00:14421] 1 exiting: rc = 0 00000100:00100000:2.0:1788211965.139039:0:16558:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8abec6cfa800:16558] 2 exiting: rc = 0 00000100:00100000:1.0:1788211965.139240:0:14420:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ac001124a00:14420] 0 exiting: rc = 1 00000100:00100000:2.0:1788211965.139385:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211965.140572:0:14424:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8abfc120a200:14424] 2 exiting: rc = 0 00000100:00100000:3.0:1788211965.140733:0:14423:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ac0012fe400:14423] 1 exiting: rc = 0 00000100:00100000:3.0:1788211965.140813:0:14422:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ac001125800:14422] 0 exiting: rc = 1 00000100:00100000:2.0:1788211965.140892:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140910:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140916:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140922:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140929:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140933:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140938:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140943:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140948:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140953:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140958:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140963:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140968:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140973:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140978:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140982:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140987:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140992:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.140997:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141001:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141006:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141011:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141022:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141027:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141032:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141037:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141051:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141057:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141063:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141068:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141073:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141078:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141083:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141088:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141093:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141102:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141267:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141284:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141290:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141295:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141300:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141305:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141311:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141315:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141320:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141325:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141331:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141336:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141341:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141345:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141352:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141357:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141362:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141493:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141498:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141504:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141509:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141514:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141519:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141524:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141529:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141533:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141538:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.141542:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788211965.143605:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788211965.143618:0:17880:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788211965.143625:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec702a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788211965.143630:0:17880:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec702a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788211965.143637:0:17880:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788211965.143682:0:17880:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfef94e000 1 00000020:00000080:2.0:1788211965.143697:0:17880:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2afbce82f55a6798 00000020:00000080:2.0:1788211965.143704:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec6694800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788211965.143764:0:17880:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788211965.143769:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788211965.143774:0:17880:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788211965.143778:0:17880:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8abfd2a199b8) has no exports 00000020:00000080:3.0:1788211965.146940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec6694800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788211965.169961:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211965.169978:0:17880:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788211965.169986:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abec6691000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788211965.169991:0:17880:0:(genops.c:844:class_export_destroy()) destroying export ffff8abec6691000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788211965.170001:0:17880:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788211965.170326:0:17880:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8abec6693800 00000020:01000000:0.0:1788211965.170348:0:17880:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788211965.170353:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788211965.170358:0:17880:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788211965.170361:0:17880:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8abfd2a18000) has no exports 00000020:00000080:0.0:1788211965.170462:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788211965.170469:0:17880:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788211965.170472:0:17880:0:(genops.c:885:class_export_put()) final put ffff8abfc6406000/OSS_uuid 00000020:00000080:0.0:1788211965.170475:0:17880:0:(genops.c:844:class_export_destroy()) destroying export ffff8abfc6406000/OSS_uuid for OSS 00000020:01000000:0.0:1788211965.170478:0:17880:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788211965.170552:0:15617:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8abec611aa00:15617] 3 exiting: rc = 0 00000100:00080000:3.0:1788211965.170929:0:14433:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788211965.171043:0:15119:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8abfcd9acc00:15119] 0 exiting: rc = 1 00000100:00100000:2.0:1788211965.171156:0:15121:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8abfe6ffd200:15121] 2 exiting: rc = 0 00000100:00100000:0.0:1788211965.173293:0:15120:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8abfffde2800:15120] 1 exiting: rc = 0 00000100:00100000:2.0:1788211965.173474:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173485:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173492:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173498:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173504:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173510:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173516:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173524:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173530:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173536:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173544:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173550:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173556:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173561:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173567:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173573:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173579:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173585:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173591:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173596:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173601:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173606:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173614:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173619:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173625:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173631:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173635:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173641:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173665:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173671:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173677:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173683:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173688:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173693:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173698:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173703:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173709:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173714:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173719:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173726:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173734:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173739:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173744:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173750:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173755:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173759:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173764:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173770:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173776:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173781:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173786:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173791:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173796:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173801:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173927:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173935:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173940:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173945:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173951:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173956:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173961:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173966:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173971:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.173988:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211965.174857:0:15124:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8abff6434800:15124] 1 exiting: rc = 0 00000100:00100000:0.0:1788211965.175072:0:15123:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8abff6434000:15123] 0 exiting: rc = 1 00000100:00100000:2.0:1788211965.175302:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175310:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175314:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175319:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175323:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175328:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175336:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175341:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175346:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175351:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175356:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175361:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175366:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175371:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175377:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175382:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175387:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175392:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175407:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175413:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175418:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175424:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175429:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175436:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175441:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175446:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175451:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175456:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175461:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175466:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175472:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175477:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175482:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175487:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175505:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175513:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175519:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175525:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175530:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175536:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175541:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175546:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175551:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175556:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175561:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175565:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175571:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175575:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175580:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175586:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175591:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175597:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175602:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175608:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175613:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175619:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175624:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175629:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175634:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175639:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175644:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175653:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175658:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.175662:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788211965.177311:0:15126:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8abfc6b73c00:15126] 1 exiting: rc = 0 00000100:00100000:0.0:1788211965.178000:0:15125:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8abfd86cc600:15125] 0 exiting: rc = 1 00000100:00100000:2.0:1788211965.178809:0:15127:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8abfc6b73000:15127] 2 exiting: rc = 0 00000100:00100000:3.0:1788211965.179730:0:16671:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8abfc465ac00:16671] 3 exiting: rc = 0 00000100:00100000:0.0:1788211965.180094:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180282:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180289:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180294:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180300:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180306:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180312:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180318:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180323:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180329:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180335:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180341:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180356:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180362:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180367:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180373:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180380:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180410:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180418:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180424:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180431:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180437:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180444:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180450:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180457:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180465:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180471:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180479:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180485:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180490:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180497:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180503:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180509:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180516:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180522:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180528:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180533:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180537:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180545:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180551:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180557:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180578:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180586:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180593:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180600:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180607:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180616:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180629:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180637:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180644:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180651:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180658:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180664:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180677:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180683:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180689:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180697:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180705:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180723:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180731:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180737:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180744:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180752:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.180767:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788211965.187463:0:15129:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8abfc6b72400:15129] 1 exiting: rc = 0 00000100:00100000:2.0:1788211965.187635:0:15128:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8abfc6b72800:15128] 0 exiting: rc = 1 00000100:00100000:0.0:1788211965.187742:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187749:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187756:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187765:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187771:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187776:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187781:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187786:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187791:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187796:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187801:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187807:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187812:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187817:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187823:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187828:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187832:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187837:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187858:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187865:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187870:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187875:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187881:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187887:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187892:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187898:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187903:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187907:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187912:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187918:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187923:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187929:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187934:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187940:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187946:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187950:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187955:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187959:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187964:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187969:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187973:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187978:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187984:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187989:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.187994:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188000:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188005:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188010:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188014:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188020:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188025:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188030:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188035:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188049:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188055:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188060:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188065:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188069:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188075:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188080:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188084:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188088:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188093:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.188098:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788211965.188922:0:15130:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8abfc6b72600:15130] 0 exiting: rc = 1 00000100:00100000:3.0:1788211965.189034:0:15131:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8abffe2dea00:15131] 1 exiting: rc = 0 00000100:00100000:0.0:1788211965.189127:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189155:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189192:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189200:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189207:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189214:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189220:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189229:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189237:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189243:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189249:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189255:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189261:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189284:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189291:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189297:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189303:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189309:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189316:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189322:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189328:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189335:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189340:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189345:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189363:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189383:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189391:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189408:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189414:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189420:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189426:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189432:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189438:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189445:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189453:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189460:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189466:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189487:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189494:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189500:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189510:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189516:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189522:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189530:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189539:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189545:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189552:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189558:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189565:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189590:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189597:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189604:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189611:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189617:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189623:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189628:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189634:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189640:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189647:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189660:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189665:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189685:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189692:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788211965.189697:0:17880:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788211965.199379:0:17880:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788211983.933507:0:18501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788211993.074296:0:18961:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788211993.074302:0:18961:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788211993.074423:0:18961:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abfd0b3f800 00000020:01000004:3.0:1788211993.074439:0:18961:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788211993.074447:0:18961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788211993.074460:0:18961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8abfd2a999b8) 00000020:00000080:3.0:1788211993.074472:0:18961:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788211993.109846:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788211993.118103:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788211993.118492:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 525: rc = 0 00100000:10000000:0.0:1788211993.118669:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788211993.118736:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 525: rc = 0 00100000:10000000:0.0:1788211993.118830:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:0.0:1788211993.118935:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 525: rc = 0 00100000:10000000:0.0:1788211993.119027:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 525: rc = 0 00100000:10000000:0.0:1788211993.119117:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:0.0:1788211993.119387:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 527: rc = 0 00100000:10000000:0.0:1788211993.125508:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 493: rc = 0 00100000:10000000:0.0:1788211993.125794:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 493: rc = 0 00100000:10000000:0.0:1788211993.126764:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 357: rc = 0 00100000:10000000:0.0:1788211993.127129:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 357: rc = 0 00100000:10000000:0.0:1788211993.128779:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 357: rc = 0 00100000:10000000:0.0:1788211993.129052:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 357: rc = 0 00100000:10000000:2.0:1788211993.133873:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211993.134224:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211993.137078:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211993.137430:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211993.137679:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 357: rc = 0 00100000:10000000:2.0:1788211993.137940:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 357: rc = 0 00100000:10000000:2.0:1788211993.138213:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1788211993.138453:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 357: rc = 0 00100000:10000000:2.0:1788211993.144835:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 509: rc = 0 00100000:10000000:2.0:1788211993.145157:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 509: rc = 0 00100000:10000000:2.0:1788211993.145648:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 509: rc = 0 00100000:10000000:2.0:1788211993.145927:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 509: rc = 0 00100000:10000000:2.0:1788211993.147843:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 509: rc = 0 00100000:10000000:2.0:1788211993.148111:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 509: rc = 0 00100000:10000000:2.0:1788211993.149708:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 509: rc = 0 00100000:10000000:2.0:1788211993.151636:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 509: rc = 0 00100000:10000000:2.0:1788211993.151931:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 509: rc = 0 00100000:10000000:2.0:1788211993.152144:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 509: rc = 0 00100000:10000000:2.0:1788211993.153646:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 509: rc = 0 00100000:10000000:2.0:1788211993.153949:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 509: rc = 0 00100000:10000000:2.0:1788211993.154265:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 509: rc = 0 00100000:10000000:2.0:1788211993.154875:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 509: rc = 0 00100000:10000000:2.0:1788211993.155123:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 509: rc = 0 00100000:10000000:2.0:1788211993.156713:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 509: rc = 0 00100000:10000000:2.0:1788211993.156984:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 509: rc = 0 00100000:10000000:2.0:1788211993.157229:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 509: rc = 0 00100000:10000000:3.0:1788211993.159091:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 509: rc = 0 00100000:10000000:3.0:1788211993.159456:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 509: rc = 0 00100000:10000000:3.0:1788211993.159695:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 509: rc = 0 00100000:10000000:3.0:1788211993.161784:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 509: rc = 0 00100000:10000000:3.0:1788211993.162092:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 509: rc = 0 00100000:10000000:3.0:1788211993.162364:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 509: rc = 0 00100000:10000000:3.0:1788211993.162596:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 509: rc = 0 00100000:10000000:3.0:1788211993.162844:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 509: rc = 0 00100000:10000000:3.0:1788211993.163097:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 509: rc = 0 00100000:10000000:3.0:1788211993.167008:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 509: rc = 0 00100000:10000000:3.0:1788211993.169143:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 509: rc = 0 00100000:10000000:3.0:1788211993.169593:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 509: rc = 0 00100000:10000000:3.0:1788211993.169812:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 509: rc = 0 00100000:10000000:3.0:1788211993.170059:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 509: rc = 0 00100000:10000000:3.0:1788211993.172587:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 371: rc = 0 00100000:10000000:3.0:1788211993.174941:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788211993.178041:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 494: rc = 0 00100000:10000000:3.0:1788211993.178284:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788211993.178342:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 494: rc = 0 00100000:10000000:3.0:1788211993.178532:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788211993.178597:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 494: rc = 0 00100000:10000000:3.0:1788211993.178975:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788211993.179044:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 496: rc = 0 00100000:10000000:3.0:1788211993.179261:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788211993.179330:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 496: rc = 0 00100000:10000000:3.0:1788211993.179515:0:18961:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788211993.179579:0:18961:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 496: rc = 0 00000020:00000080:3.0:1788211993.179872:0:18961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788211993.179880:0:18961:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788211993.179890:0:18961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6c06 00000020:01000004:3.0:1788211993.179898:0:18961:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788211993.179903:0:18961:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788211993.183478:0:18961:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfd0b3f800 from MGS 00000020:01000004:3.0:1788211993.183485:0:18961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788211993.183502:0:18961:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8abfd2a9b370) 00000020:00000080:3.0:1788211993.183527:0:18961:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788211993.183604:0:18961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfd0b3f800 from MGS, refs=2 00080000:01000000:3.0:1788211993.183613:0:18961:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788211993.183620:0:18961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6c14 00000100:00100000:3.0:1788211993.183790:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788211993.184493:0:18961:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788211993.184501:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788211993.193420:0:18961:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788211993.197489:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788211993.210718:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788211993.211009:0:18961:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788211993.211017:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788211993.214914:0:18961:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788211993.214929:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788211993.215563:0:18961:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788211993.215571:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788211993.217034:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211993.217040:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211993.217042:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211993.222018:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211993.222027:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211993.222029:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788211993.230070:0:18961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788211993.239019:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788211993.259537:0:18961:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788211993.259556:0:18961:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788211993.259559:0:18961:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788211993.261716:0:18970:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788211993.261970:0:18961:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788211993.262293:0:18961:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788211993.263204:0:18961:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788211993.264785:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211993.265035:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788211993.265048:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788211993.270623:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788211993.270641:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788211993.271504:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788211993.271515:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788211993.285890:0:18961:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788211993.285919:0:18961:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.129@tcp' 00000020:01000004:1.0:1788211993.285921:0:18961:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788211993.285951:0:18961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.129@tcp (typ=mgc) 00000020:00000080:1.0:1788211993.285964:0:18961:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.129@tcp (ffff8abec66f4d28) 00000020:00000080:1.0:1788211993.285981:0:18961:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1788211993.286049:0:18975:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788211993.286067:0:18961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abfc542a000@MGC192.168.204.129@tcp: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1788211993.287202:0:18961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.129@tcp-0 is initialized 00000040:01000000:1.0:1788211993.287220:0:18961:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788211993.291031:0:18976:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788211993.291088:0:18961:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.129@tcp (uuid d9c126b8-6169-4174-8e0e-db6a3254d2db) 00000020:00000080:1.0:1788211993.291120:0:18961:0:(genops.c:1385:class_connect()) connect: client d9c126b8-6169-4174-8e0e-db6a3254d2db, cookie 0x2afbce82f55a6c22 00000100:00080000:1.0:1788211993.291150:0:18961:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788211993.291158:0:18961:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff8abfc542a000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1788211993.291217:0:18961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001241180 x1875075660893824/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788211993.291243:0:18961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d9c126b8-6169-4174-8e0e-db6a3254d2db->MGS 00000020:01000004:1.0:1788211993.291264:0:18961:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788211993.291269:0:18961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788211993.291294:0:18961:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8abec66f3370) 00000020:00000080:1.0:1788211993.291306:0:18961:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788211993.295912:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9c126b8-6169-4174-8e0e-db6a3254d2db:3307:1875075660893824:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788211993.295994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211993.296069:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893824 00000100:00100000:0.0:1788211993.296077:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893824 00000100:00100000:0.0:1788211993.296110:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211993.296125:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec114cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875075660893824:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788211993.296151:0:18971:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d9c126b8-6169-4174-8e0e-db6a3254d2db@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:0.0:1788211993.296469:0:18971:0:(genops.c:1385:class_connect()) connect: client d9c126b8-6169-4174-8e0e-db6a3254d2db, cookie 0x2afbce82f55a6c30 00000100:00080000:0.0:1788211993.296668:0:18971:0:(import.c:65:import_set_state_nolock()) ffff8abfd8396000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788211993.296740:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec114cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:3307:x1875075660893824:12345-0@lo:250:mount.lustre.0 Request processed in 614us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.296749:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211993.296796:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788211993.296807:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1788211993.296814:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788211993.296819:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788211993.296822:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfc542a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788211993.296825:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788211993.296833:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788211993.296838:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9c126b8-6169-4174-8e0e-db6a3254d2db:3307:1875075660893824:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788211993.313766:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211993.314760:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788211993.314767:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788211993.316500:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788211993.316510:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788211993.317344:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788211993.317367:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788211993.320006:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211993.321080:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788211993.321091:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788211993.322066:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788211993.322075:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788211993.395141:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211993.399261:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788211993.399273:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788211993.407455:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788211993.412957:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788211993.416407:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788211993.416605:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788211993.416612:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788211993.417568:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788211993.417579:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788211993.419142:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211993.419597:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788211993.419605:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788211993.420560:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788211993.420569:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788211993.421487:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788211993.421659:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788211993.421665:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788211993.422841:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788211993.422863:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788211993.453592:0:18961:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788211993.453941:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788211993.453952:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788211993.455840:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788211993.455865:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788211993.465452:0:18961:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788211993.465466:0:18961:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788211993.466821:0:18961:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788211993.466861:0:18961:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788211993.466868:0:18961:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788211993.467067:0:18961:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788211993.467115:0:18961:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788211993.467120:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788211993.467122:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211993.467123:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211993.467124:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211993.467125:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211993.467126:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211993.467128:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211993.467130:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211993.467131:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211993.467133:0:18961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211993.467136:0:18961:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788211993.467138:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788211993.467139:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788211993.467140:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788211993.467141:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788211993.467142:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788211993.467142:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788211993.467143:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788211993.467144:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788211993.467146:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788211993.467147:0:18961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788211993.467211:0:18961:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788211993.467238:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660893952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788211993.467357:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.467433:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6579e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.469256:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660893952 00000100:00100000:0.0:1788211993.469276:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660893952 00000100:00100000:0.0:1788211993.469707:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788211993.469719:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec114f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:18961:x1875075660893952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788211993.469804:0:18974:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788211993.469807:0:18974:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788211993.469810:0:18974:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788211993.471655:0:18995:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788211993.472357:0:18974:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1788211993.474146:0:18996:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788211993.474156:0:18996:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788211993.474159:0:18996:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788211993.474615:0:18996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788211993.475550:0:18974:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788211993.475562:0:18974:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788211993.482889:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec114f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:18961:x1875075660893952:12345-0@lo:253:mount.lustre.0 Request processed in 13162us (15523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.482904:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211993.483012:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660893952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788211993.483028:0:18961:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788211993.483031:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788211993.483033:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211993.483035:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211993.483036:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211993.483038:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211993.483039:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211993.483040:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211993.483042:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211993.483044:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211993.483055:0:18961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788211993.483082:0:18961:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfd0b3f800 from lustre-MDT0000 10000000:01000000:2.0:1788211993.483115:0:18961:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788211993.483118:0:18961:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788211993.483123:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8abec66f4d28 10000000:01000000:2.0:1788211993.483127:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788211993.483135:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8abec66f4d28 from 1 10000000:01000000:2.0:1788211993.483139:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788211993.483201:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.483232:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.483245:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.483281:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211993.483327:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.483374:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.483583:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894080 00000100:00100000:0.0:1788211993.483593:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894080 00000100:00100000:0.0:1788211993.483639:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788211993.483650:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:18961:x1875075660894080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211993.483670:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211993.483693:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a6c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6c37 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.483721:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a6c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6c37 expref: 6 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.483731:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0031600/0x2afbce82f55a6c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6c37 expref: 6 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.483742:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031600, rc 0) 00000100:00100000:0.0:1788211993.483787:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+6:18961:x1875075660894080:12345-0@lo:101:mount.lustre.0 Request processed in 139us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.483803:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788211993.483892:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211993.483904:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.483914:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.483961:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211993.483987:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.484017:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211993.484097:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894208 00000100:00100000:1.0:1788211993.484102:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894208 00000100:00100000:1.0:1788211993.484136:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788211993.484143:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+6:18961:x1875075660894208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.484595:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+6:18961:x1875075660894208:12345-0@lo:501:mount.lustre.0 Request processed in 451us (605us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788211993.484602:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788211993.484684:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894208:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788211993.484717:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788211993.484738:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.484747:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211993.484768:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfd0b3f800 10000000:01000000:2.0:1788211993.484773:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788211993.484778:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8abfd0b3f800 10000000:01000000:2.0:1788211993.484780:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788211993.484784:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8abfd0b3f800 from 1 10000000:01000000:2.0:1788211993.484787:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788211993.484809:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.484817:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.484825:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.484839:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211993.484877:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.484900:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211993.484922:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894336 00000100:00100000:2.0:1788211993.484927:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894336 00000100:00100000:2.0:1788211993.484951:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211993.484957:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+6:18961:x1875075660894336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211993.484965:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211993.484977:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a6c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6c45 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.484994:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a6c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6c45 expref: 7 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485014:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80800/0x2afbce82f55a6c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6c45 expref: 7 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485023:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80800, rc 0) 00000100:00100000:2.0:1788211993.485064:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+7:18961:x1875075660894336:12345-0@lo:101:mount.lustre.0 Request processed in 107us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211993.485070:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788211993.485100:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211993.485110:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c4c expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485118:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6c4c expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211993.485129:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788211993.485133:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c4c expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485140:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb81400/0x2afbce82f55a6c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c4c expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211993.485146:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788211993.485149:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788211993.485153:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8abfd0b3f800 10000000:01000000:2.0:1788211993.485156:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788211993.485158:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788211993.485160:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788211993.485200:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485208:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.485216:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.485228:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211993.485251:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211993.485407:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894464 00000100:00100000:0.0:1788211993.485412:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894464 00000100:00100000:0.0:1788211993.485432:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788211993.485439:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+7:18961:x1875075660894464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211993.485447:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211993.485456:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a6c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6c53 expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.485470:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a6c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6c53 expref: 8 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.485478:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030a00/0x2afbce82f55a6c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6c53 expref: 8 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.485484:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030a00, rc 0) 00000100:00100000:0.0:1788211993.487068:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+8:18961:x1875075660894464:12345-0@lo:101:mount.lustre.0 Request processed in 1607us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.487081:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788211993.487423:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211993.487447:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211993.487467:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c5a expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.487479:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6c5a expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.487546:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788211993.487588:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.487655:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788211993.487718:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894592 00000100:00100000:1.0:1788211993.487724:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894592 00000100:00100000:1.0:1788211993.487801:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788211993.487811:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+8:18961:x1875075660894592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.488546:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18961:x1875075660894592:12345-0@lo:501:mount.lustre.0 Request processed in 733us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211993.488556:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788211993.488673:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211993.488714:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211993.488757:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.488832:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff65790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788211993.488882:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894720 00000100:00100000:1.0:1788211993.488887:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894720 00000100:00100000:1.0:1788211993.488921:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788211993.488935:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18961:x1875075660894720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211993.489510:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18961:x1875075660894720:12345-0@lo:503:mount.lustre.0 Request processed in 572us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211993.489518:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788211993.489609:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660894720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211993.490030:0:18997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:18997:1875075660894848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211993.490090:0:18997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.490122:0:18997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6579840 going to sleep for 11 seconds 00000100:00100000:2.0:1788211993.490246:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660894848 00000100:00100000:2.0:1788211993.490253:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660894848 00000100:00100000:2.0:1788211993.490309:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788211993.490319:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18997:x1875075660894848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211993.490619:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18997:x1875075660894848:12345-0@lo:502:llog_process_th.0 Request processed in 301us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211993.490636:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788211993.491129:0:18997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:18997:1875075660894848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211993.491183:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211993.491198:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.491201:0:18997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788211993.491209:0:18997:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788211993.491212:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788211993.491228:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8abfd2a98000) 00000020:00000080:3.0:1788211993.491253:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788211993.491259:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788211993.491791:0:18997:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788211993.491800:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6c68 00000020:00000080:1.0:1788211993.492043:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788211993.492061:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788211993.492067:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211993.492069:0:18997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788211993.492072:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788211993.492077:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788211993.492079:0:18997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788211993.492083:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788211993.492092:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8abec66f0000) 00000020:00000080:1.0:1788211993.492104:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788211993.492108:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788211993.492110:0:18997:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788211993.492113:0:18997:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788211993.492118:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788211993.492209:0:18997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfd0b3f800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788211993.492224:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8abec66f19b8) 00000020:00000080:1.0:1788211993.492232:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788211993.492414:0:18997:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788211993.492421:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6c7d 00000020:00000080:1.0:1788211993.492535:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788211993.492541:0:18997:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788211993.492546:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2afbce82f55a6c84 00080000:01000000:1.0:1788211993.492552:0:18997:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788211993.492555:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6c8b 00010000:00010000:2.0:1788211993.594776:0:18997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788211993.596739:0:18997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788211993.597615:0:18997:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788211993.598716:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8abfd2a9cd28) 00000020:00000080:3.0:1788211993.598755:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788211993.598871:0:18997:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788211993.598883:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6c99 00000020:00000080:2.0:1788211993.601965:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788211993.630117:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2afbce82f55a6ca0 00000020:00000080:0.0:1788211993.631825:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788211993.631841:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211993.631858:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211993.631861:0:18997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788211993.631867:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788211993.631870:0:18997:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788211993.631872:0:18997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788211993.631873:0:18997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788211993.631874:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788211993.631886:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211993.631887:0:18997:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788211993.631891:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788211993.631897:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211993.631898:0:18997:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788211993.631903:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788211993.631951:0:18997:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788211993.631970:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788211993.631973:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211993.631974:0:18997:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788211993.631976:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788211993.631980:0:18997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788211993.631983:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788211993.631984:0:18997:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788211993.631987:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788211993.631992:0:18997:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:0.0:1788211993.632024:0:18997:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788211993.632026:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788211993.632063:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8abfd2a199b8) 00000020:00000080:0.0:1788211993.632088:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788211993.632094:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788211993.632214:0:18997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788211993.632221:0:18997:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788211993.632230:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6cae 00010000:00080000:0.0:1788211993.632297:0:18997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abfc542d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1788211993.632562:0:18997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788211993.637933:0:18997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788211993.637991:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788211993.643230:0:18997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211993.643308:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788211993.643927:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788211993.644748:0:19001:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788211993.644760:0:19001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788211993.647652:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788211993.647671:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788211993.647726:0:18997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788211993.647750:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6cb5 00000100:00080000:3.0:1788211993.647764:0:18997:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788211993.647772:0:18997:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abfc542d000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211993.647823:0:18997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9a9c00 x1875075660894976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788211993.647868:0:18997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788211993.647985:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211993.647991:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.647993:0:18997:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788211993.647997:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788211993.647999:0:18997:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788211993.648001:0:18997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788211993.648003:0:18997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788211993.648005:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788211993.648007:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.648009:0:18997:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788211993.648012:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788211993.648016:0:18997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788211993.648020:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.648021:0:18997:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788211993.648023:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788211993.648028:0:18997:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:3.0:1788211993.648069:0:18997:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788211993.648071:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788211993.648086:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8abff7020000) 00000020:00000080:3.0:1788211993.648099:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788211993.648122:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788211993.648239:0:18997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788211993.648246:0:18997:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788211993.648255:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2afbce82f55a6cc3 00010000:00080000:3.0:1788211993.648308:0:18997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec587e800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.129@tcp at head 00000100:00100000:0.0:1788211993.648498:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660894976:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788211993.648562:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660894976 offset 0 length 520: 4 00010000:00010000:3.0:1788211993.648986:0:18997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788211993.649590:0:18997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788211993.649618:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788211993.650994:0:18997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788211993.651771:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788211993.651894:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788211993.652799:0:19003:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788211993.652806:0:19003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788211993.659496:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788211993.659515:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788211993.659563:0:18997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788211993.659589:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6cca 00000100:00080000:3.0:1788211993.659602:0:18997:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788211993.659608:0:18997:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788211993.659652:0:18997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9aaa00 x1875075660895104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788211993.659727:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660895104:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788211993.659814:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660895104 offset 0 length 520: 4 00000100:00080000:3.0:1788211993.659884:0:18997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788211993.659955:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211993.659960:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.659962:0:18997:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788211993.659965:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211993.659969:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.659971:0:18997:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788211993.659974:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788211993.659976:0:18997:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788211993.659979:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211993.659981:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.659982:0:18997:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788211993.659994:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788211993.659997:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.659999:0:18997:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788211993.660002:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788211993.660042:0:18997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:18997:1875075660895232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211993.660105:0:18997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.660129:0:18997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788211993.660873:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895232 00000100:00100000:2.0:1788211993.660883:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895232 00000100:00100000:2.0:1788211993.660944:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788211993.660956:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18997:x1875075660895232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211993.661591:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18997:x1875075660895232:12345-0@lo:502:llog_process_th.0 Request processed in 635us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211993.661600:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788211993.662236:0:18997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:18997:1875075660895232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788211993.662292:0:18997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788211993.662303:0:18997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788211993.662305:0:18997:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788211993.662312:0:18997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788211993.664423:0:18961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788211993.664470:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788211993.664493:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c5a expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.664507:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80a00/0x2afbce82f55a6c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c5a expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788211993.664517:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfd0b3f800 from 1 10000000:01000000:2.0:1788211993.664521:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788211993.664574:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.664583:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.664609:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788211993.664654:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788211993.664727:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.664779:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515000 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.665974:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895360 00000100:00100000:0.0:1788211993.665994:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895360 00000100:00100000:0.0:1788211993.667748:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788211993.667775:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+9:18961:x1875075660895360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788211993.667798:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788211993.667823:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6cd1 expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.667864:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 10 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.667877:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 10 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.667886:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030e00, rc 0) 00000100:00100000:0.0:1788211993.667982:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+10:18961:x1875075660895360:12345-0@lo:101:mount.lustre.0 Request processed in 220us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.667990:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788211993.668536:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211993.668562:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.668574:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211993.670609:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895488:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788211993.670709:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211993.670771:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6631480 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.671225:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895488 00000100:00100000:3.0:1788211993.671238:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895488 00000100:00100000:3.0:1788211993.671430:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788211993.671444:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+10:18961:x1875075660895488:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788211993.671470:0:18971:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788211993.671477:0:18971:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788211993.673597:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+10:18961:x1875075660895488:12345-0@lo:256:mount.lustre.0 Request processed in 2148us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.673610:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788211993.673926:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895488:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788211993.676567:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788211993.676649:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.676670:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788211993.676739:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfd0b3f800 from 1 10000000:01000000:3.0:1788211993.676743:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788211993.676796:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.676805:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.676816:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211993.676868:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788211993.676940:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.676989:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6f45240 going to sleep for 11 seconds 00000100:00100000:2.0:1788211993.677224:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895616 00000100:00100000:2.0:1788211993.677235:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895616 00000100:00100000:2.0:1788211993.677296:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788211993.677307:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+10:18961:x1875075660895616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788211993.677322:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788211993.677337:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6cdf expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.677486:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.677502:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.677513:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80e00, rc 0) 00000100:00100000:2.0:1788211993.677620:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660895616:12345-0@lo:101:mount.lustre.0 Request processed in 314us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211993.677627:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788211993.677950:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211993.677966:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.677976:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211993.678117:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.678150:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.678342:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc80123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.678534:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895744 00000100:00100000:0.0:1788211993.678551:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895744 00000100:00100000:0.0:1788211993.678634:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788211993.678644:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660895744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211993.683313:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660895744:12345-0@lo:501:mount.lustre.0 Request processed in 4658us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.683332:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788211993.688228:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.688504:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211993.689123:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.689339:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc80123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.689513:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660895872 00000100:00100000:0.0:1788211993.689522:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660895872 00000100:00100000:0.0:1788211993.689636:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788211993.689647:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660895872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788211993.689898:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660895872:12345-0@lo:503:mount.lustre.0 Request processed in 252us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.689906:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788211993.689997:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660895872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211993.695517:0:19005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19005:1875075660896000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211993.695638:0:19005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.695729:0:19005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd8515b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.696879:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896000 00000100:00100000:0.0:1788211993.696894:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896000 00000100:00100000:0.0:1788211993.696967:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788211993.696980:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:19005:x1875075660896000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211993.698659:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:19005:x1875075660896000:12345-0@lo:502:llog_process_th.0 Request processed in 1673us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.698674:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788211993.699718:0:19005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19005:1875075660896000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211993.699768:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211993.699791:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.699794:0:19005:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788211993.699803:0:19005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfd0b3f800 00000020:00000080:2.0:1788211993.699806:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788211993.699814:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211993.699817:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.699818:0:19005:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788211993.699821:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211993.699823:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.699825:0:19005:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788211993.699828:0:19005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfd0b3f800 00000020:00000080:2.0:1788211993.699830:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788211993.699968:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211993.699972:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.699974:0:19005:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788211993.699977:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788211993.699979:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.699980:0:19005:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788211993.699984:0:19005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfd0b3f800 00000020:00000080:2.0:1788211993.699986:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788211993.704654:0:19005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19005:1875075660896128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211993.704770:0:19005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.704829:0:19005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.705058:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896128 00000100:00100000:3.0:1788211993.705069:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896128 00000100:00100000:3.0:1788211993.705137:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788211993.705150:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcacc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:19005:x1875075660896128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211993.706119:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcacc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:19005:x1875075660896128:12345-0@lo:502:llog_process_th.0 Request processed in 966us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.706132:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788211993.706696:0:19005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19005:1875075660896128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788211993.706743:0:19005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788211993.706752:0:19005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788211993.706755:0:19005:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788211993.706760:0:19005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788211993.711238:0:18961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788211993.711424:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788211993.711458:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.711472:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788211993.711529:0:18961:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788211993.711533:0:18961:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfd0b3f800 10000000:01000000:1.0:1788211993.711536:0:18961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfd0b3f800 10000000:01000000:1.0:1788211993.711541:0:18961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788211993.711547:0:18961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfd0b3f800 from 1 10000000:01000000:1.0:1788211993.711549:0:18961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788211993.711594:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.711603:0:18961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.711615:0:18961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211993.711644:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788211993.711715:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.713258:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.713490:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896256 00000100:00100000:3.0:1788211993.713499:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896256 00000100:00100000:3.0:1788211993.713560:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788211993.713570:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcacca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660896256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788211993.713586:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211993.713608:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4800/0x2afbce82f55a6cf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6ced expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.713635:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4800/0x2afbce82f55a6cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6ced expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.713646:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4800/0x2afbce82f55a6cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6ced expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.713668:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4800, rc 0) 00000100:00100000:3.0:1788211993.714474:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcacca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660896256:12345-0@lo:101:mount.lustre.0 Request processed in 899us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.714484:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788211993.714852:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788211993.714877:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cf4 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.714891:0:18961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6cf4 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211993.714969:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.715019:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.717465:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.722794:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896384 00000100:00100000:3.0:1788211993.722814:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896384 00000100:00100000:3.0:1788211993.722903:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788211993.722916:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660896384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788211993.727704:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660896384:12345-0@lo:501:mount.lustre.0 Request processed in 4778us (12671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.727723:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788211993.727925:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788211993.728000:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788211993.729236:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.730379:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.730544:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896512 00000100:00100000:3.0:1788211993.730555:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896512 00000100:00100000:3.0:1788211993.730620:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788211993.730630:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660896512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788211993.730877:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660896512:12345-0@lo:503:mount.lustre.0 Request processed in 248us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.730887:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788211993.731033:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660896512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788211993.735580:0:19010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19010:1875075660896640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788211993.735683:0:19010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.735744:0:19010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.735877:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896640 00000100:00100000:3.0:1788211993.735889:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896640 00000100:00100000:3.0:1788211993.735940:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788211993.735950:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19010:x1875075660896640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211993.738865:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19010:x1875075660896640:12345-0@lo:502:llog_process_th.0 Request processed in 2891us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211993.738882:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788211993.740638:0:19010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19010:1875075660896640:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788211993.740721:0:19010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788211993.740736:0:19010:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8abfd8363370) 00000020:00000080:2.0:1788211993.740761:0:19010:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788211993.740880:0:19010:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfd0b3f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788211993.740885:0:19010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfd0b3f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788211993.740887:0:19010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfd0b3f800 4 00010000:00080000:2.0:1788211993.740929:0:19010:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac001336800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1788211993.748972:0:19010:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788211993.749286:0:19010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788211993.749328:0:19010:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788211993.749344:0:19010:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2afbce82f55a6d02 00000100:00080000:2.0:1788211993.749358:0:19010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788211993.749364:0:19010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ac001336800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788211993.749402:0:19010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001203100 x1875075660896768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788211993.749444:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660896768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788211993.752073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.752272:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896768 00000100:00100000:2.0:1788211993.752282:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896768 00000100:00100000:2.0:1788211993.752322:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211993.752331:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660896768:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788211993.752393:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875075660896768:12345-0@lo:38:llog_process_th.0 Request processed in 63us (328us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788211993.752401:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788211993.752443:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788211993.752451:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8ac001336800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788211993.752480:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788211993.752484:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660896768:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788211993.752508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211993.752513:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211993.752515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211993.752519:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211993.752530:0:19010:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788211993.752543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211993.752546:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788211993.752548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788211993.752550:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788211993.758730:0:19010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19010:1875075660896896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788211993.758821:0:19010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.758877:0:19010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc3413180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.758946:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660896896 00000100:00100000:0.0:1788211993.758956:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660896896 00000100:00100000:0.0:1788211993.759020:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788211993.759034:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19010:x1875075660896896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788211993.759649:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19010:x1875075660896896:12345-0@lo:502:llog_process_th.0 Request processed in 616us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.759660:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788211993.761578:0:19010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9c126b8-6169-4174-8e0e-db6a3254d2db:19010:1875075660896896:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788211993.761637:0:19010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788211993.762590:0:18961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788211993.762623:0:18961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788211993.762650:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cf4 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788211993.762664:0:18961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06600/0x2afbce82f55a6ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6cf4 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788211993.762718:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788211993.762720:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211993.762722:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211993.762723:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211993.762725:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211993.762726:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211993.762728:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211993.762730:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211993.762738:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211993.762740:0:18961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211993.762743:0:18961:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788211993.762746:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788211993.762747:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211993.762748:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211993.762749:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211993.762750:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211993.762751:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211993.762751:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211993.762752:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211993.762753:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211993.762754:0:18961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788211993.762789:0:18961:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788211993.762811:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660897024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788211993.762905:0:18961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211993.762949:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff701f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788211993.763073:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897024 00000100:00100000:3.0:1788211993.763082:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897024 00000100:00100000:3.0:1788211993.763136:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788211993.763148:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18961:x1875075660897024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788211993.764377:0:18974:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788211993.764398:0:18974:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788211993.859054:0:18974:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788211993.859071:0:18974:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788211993.859094:0:18995:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788211993.859099:0:18995:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788211993.859122:0:18995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.859144:0:18995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.859152:0:18995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.859391:0:18995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.859406:0:18995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 12 pid: 18974 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211993.859437:0:18995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660897152:0@lo:104: 00000100:00100000:3.0:1788211993.859507:0:18995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788211993.859715:0:18995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc3413180 going to sleep for 11 seconds 00000100:00100000:0.0:1788211993.860630:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897152 00000100:00100000:0.0:1788211993.860642:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897152 00000100:00100000:0.0:1788211993.860692:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788211993.860710:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660897152:12345-0@lo:104: 00010000:00010000:0.0:1788211993.860725:0:18962:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.860857:0:18962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788211993.860864:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660897152:12345-0@lo:104: Request processed in 156us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788211993.860873:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788211993.860894:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788211993.860900:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.860908:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788211993.860912:0:18968:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.860921:0:18968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788211993.860928:0:18968:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788211993.860934:0:18968:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788211993.860967:0:18968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.860973:0:18968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788211993.860992:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.861008:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abffdb81800/0x2afbce82f55a6cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6cd8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211993.861026:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211993.861028:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788211993.861029:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788211993.861060:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660897280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788211993.861094:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211993.861226:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897280 00000100:00100000:1.0:1788211993.861231:0:18964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897280 00010000:00010000:1.0:1788211993.861251:0:18964:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 13 pid: 18974 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211993.861432:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211993.861441:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+13:3311:x1875075660897280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788211993.861453:0:18964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788211993.861459:0:18964:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 13 pid: 18974 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861469:0:18964:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 13 pid: 18974 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861495:0:18964:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861504:0:18964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788211993.861520:0:18964:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002421669s 00010000:00010000:1.0:1788211993.861524:0:18964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861530:0:18964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861537:0:18964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861543:0:18964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861548:0:18964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788211993.861553:0:18964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861560:0:18964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861568:0:18964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211993.861577:0:18964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788211993.861613:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+13:3311:x1875075660897280:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211993.861625:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788211993.861662:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660897280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788211993.862028:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a6cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6cd1 expref: 12 pid: 18974 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788211993.862041:0:18995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660897152:0@lo:104: 00010000:00010000:3.0:1788211993.862058:0:18995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.862067:0:18995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.862074:0:18995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211993.862080:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211993.875691:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18961:x1875075660897024:12345-0@lo:253:mount.lustre.0 Request processed in 112535us (112776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211993.875708:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788211993.879490:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:18961:1875075660897024:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788211993.879518:0:18961:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788211993.879521:0:18961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788211993.879523:0:18961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788211993.879524:0:18961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788211993.879525:0:18961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788211993.879527:0:18961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788211993.879528:0:18961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788211993.879529:0:18961:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788211993.879531:0:18961:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788211993.879533:0:18961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788211993.879535:0:18961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788211993.879554:0:18961:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788211993.892539:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211993.892743:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211993.893062:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211993.895491:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788211993.895932:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788211993.896102:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211993.897914:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211993.898089:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211993.898476:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211993.898676:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788211993.898928:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788211993.899076:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788211993.964157:0:18961:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:0.0:1788211993.965641:0:18961:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788211993.971580:0:19020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788211993.971724:0:19020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788211993.974527:0:18961:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788211993.974649:0:18961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788211993.975069:0:18961:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788211993.975079:0:18961:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1788211993.976547:0:19019:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:2.0:1788211993.976557:0:19019:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:00080000:1.0:1788211993.980547:0:18961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788211993.982124:0:19020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788211993.982478:0:19020:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788211993.982484:0:19020:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788211993.983692:0:18961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788211993.984361:0:18961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788211993.984402:0:18961:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788211993.984905:0:18961:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788211993.986116:0:18961:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788211993.990827:0:18961:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788211994.042311:0:18961:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788211994.042522:0:18961:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa765c189f988 00100000:10000000:1.0:1788211994.042535:0:18961:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788211994.043655:0:18961:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788211994.043672:0:18961:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788211994.043684:0:18961:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788211994.043703:0:18961:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788211994.278625:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788211994.533542:0:18976:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788211994.533553:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfd0b3f800 from 9 10000000:01000000:0.0:1788211994.533559:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788211994.533805:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211994.533821:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788211994.533845:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788211994.533878:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660897408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788211994.534003:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788211994.534074:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc3d62600 going to sleep for 11 seconds 00000100:00100000:3.0:1788211994.534917:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897408 00000100:00100000:3.0:1788211994.534930:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897408 00000100:00100000:3.0:1788211994.534996:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788211994.535020:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcc50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18976:x1875075660897408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788211994.535037:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788211994.535053:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d10 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211994.535078:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211994.535089:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788211994.535098:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4000, rc 0) 00000100:00100000:3.0:1788211994.535189:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcc50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660897408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211994.535196:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788211994.535811:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660897408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788211994.535843:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211994.535854:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788211994.535926:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660897536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788211994.535967:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211994.536014:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104480 going to sleep for 11 seconds 00000100:00100000:0.0:1788211994.536533:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897536 00000100:00100000:0.0:1788211994.536541:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897536 00000100:00100000:3.0:1788211994.536662:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788211994.536673:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660897536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788211994.536692:0:18974:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788211994.536711:0:18974:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788211994.536714:0:18974:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788211994.536823:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660897536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788211994.536843:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788211994.537122:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660897536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788211994.537220:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788211994.537239:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788211994.537258:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788211994.792780:0:19011:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788211994.792789:0:19011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788211994.801062:0:19011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788211994.801079:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788211995.307831:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788211995.813548:0:19011:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788211995.813563:0:19011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211995.814146:0:19011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788211995.814274:0:19011:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788211995.814323:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788211996.326073:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211997.367468:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788211998.373404:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788211998.949471:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788211998.949477:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788211998.949481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788211998.949484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788211998.949487:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788211998.949490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788211998.949493:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ac001336800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788211998.949505:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ac001336800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788211998.949526:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abffde65880 x1875075660897792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788211998.949666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660897664:0@lo:400:kworker.0 00000100:00100000:1.0:1788211998.949753:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788211998.949831:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897664 00000100:00100000:1.0:1788211998.949837:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897664 00000100:00100000:1.0:1788211998.949881:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788211998.949890:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3308:x1875075660897664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788211998.949941:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3308:x1875075660897664:12345-0@lo:400:kworker.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788211998.949958:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788211998.950010:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660897664:0@lo:400:kworker.0 00000100:00100000:1.0:1788211998.954726:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660897792:0@lo:38:kworker.0 00000100:00100000:1.0:1788211998.954953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788211998.955065:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897792 00000100:00100000:2.0:1788211998.955074:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897792 00000100:00100000:2.0:1788211998.955116:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788211998.955124:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875075660897792:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788211998.955153:0:18981:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:2.0:1788211998.955206:0:18981:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2afbce82f55a6d1e 00000004:00100000:2.0:1788211998.955225:0:18981:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788211998.955474:0:18981:0:(import.c:65:import_set_state_nolock()) ffff8abfef669000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788211998.955634:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8abffde65880 x1875075660897792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788212008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788211998.955648:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788211998.955656:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788211998.955661:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788211998.955664:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8ac001336800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788211998.955669:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875075660897792:0@lo:38:kworker.0 00000100:00100000:2.0:1788211998.958701:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875075660897792:12345-0@lo:38:kworker.0 Request processed in 3565us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788211998.958716:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788211999.397779:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788211999.846959:0:19263:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788212000.421386:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212001.445453:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212002.470597:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788212003.046202:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211993/real 1788211993] req@ffff8abfef9aaa00 x1875075660895104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212003.046239:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8abfef9aaa00 x1875075660895104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212003.046251:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788211993/real 1788211993] req@ffff8abfef9a9c00 x1875075660894976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212003.046263:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8abfef9a9c00 x1875075660894976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788212003.046283:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788212003.046300:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788212003.046305:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660895104:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788212003.046320:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfc542d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788212003.046326:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788212003.046329:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660894976:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788212003.046401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212003.046406:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788212003.046408:0:8:0:(import.c:65:import_set_state_nolock()) ffff8abfc542d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788212003.046413:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 582 00000100:00080000:2.0:1788212003.046418:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788212003.046424:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abfc542d000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788212003.046445:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001203b80 x1875075660898048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788212003.046737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212003.046740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788212003.046742:0:8:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788212003.046745:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 582 00000100:00080000:2.0:1788212003.046748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788212003.046752:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788212003.046767:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001201c00 x1875075660898176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788212003.046812:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660897920:0@lo:400:kworker.0 00000100:00100000:2.0:1788212003.046880:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212003.046944:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660898304:0@lo:400:kworker.0 00000100:00100000:2.0:1788212003.046972:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212003.047015:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660897920 00000100:00100000:2.0:1788212003.047023:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660897920 00000100:00100000:2.0:1788212003.047068:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788212003.047077:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec5208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3309:x1875075660897920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212003.047124:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec5208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3309:x1875075660897920:12345-0@lo:400:kworker.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212003.047131:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788212003.049835:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898304 00000100:00100000:2.0:1788212003.049848:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898304 00000100:00100000:2.0:1788212003.049905:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788212003.049916:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660898304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212003.050320:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660898304:12345-0@lo:400:kworker.0 Request processed in 404us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212003.050329:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788212003.050380:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660897920:0@lo:400:kworker.0 00000100:00100000:2.0:1788212003.050413:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660898048:0@lo:8:kworker.0 00000400:00000100:2.0:1788212003.050461:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660898048 offset 0 length 520: 4 00000100:00100000:2.0:1788212003.050489:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660898176:0@lo:8:kworker.0 00000400:00000100:2.0:1788212003.050513:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875075660898176 offset 0 length 520: 4 00010000:00080000:3.0:1788212003.050639:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac001203800 x1875075660898304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788212003.050653:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660898304:0@lo:400:kworker.0 00000020:00000080:3.0:1788212003.312816:0:19414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc08126a50 20000000:00000080:3.0:1788212003.312912:0:19414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac00075bc00 uarg=0000000000000000 20000000:01000000:3.0:1788212003.312953:0:19414:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788212003.312963:0:19414:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788212003.312969:0:19414:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788212003.313912:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788212003.314111:0:19414:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788212003.320786:0:19414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788212003.320831:0:19414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.320853:0:19414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.320861:0:19414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.320915:0:19414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.320931:0:19414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212003.320947:0:19414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19414:1875075660898432:0@lo:104: 00000100:00100000:3.0:1788212003.321030:0:19414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212003.321111:0:19414:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca9cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788212003.321265:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898432 00000100:00100000:1.0:1788212003.321273:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898432 00000100:00100000:1.0:1788212003.321316:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788212003.321326:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:19414:x1875075660898432:12345-0@lo:104: 00010000:00010000:1.0:1788212003.321339:0:18963:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321400:0:18963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788212003.321406:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:19414:x1875075660898432:12345-0@lo:104: Request processed in 82us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212003.321435:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788212003.321475:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212003.321481:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321489:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788212003.321493:0:18968:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321501:0:18968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788212003.321508:0:18968:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788212003.321514:0:18968:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788212003.321544:0:18968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321551:0:18968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788212003.321577:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321584:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5a00/0x2afbce82f55a6cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ce6 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321606:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212003.321608:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212003.321610:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212003.321628:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788212003.321645:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660898560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788212003.321687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212003.321719:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898560 00000100:00100000:1.0:1788212003.321723:0:18964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898560 00010000:00010000:1.0:1788212003.321741:0:18964:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 12 pid: 18973 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212003.321763:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788212003.321770:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3310:x1875075660898560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788212003.321779:0:18964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788212003.321784:0:18964:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 12 pid: 18973 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321794:0:18964:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 12 pid: 18973 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321810:0:18964:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321817:0:18964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321831:0:18964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321838:0:18964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321844:0:18964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321861:0:18964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321867:0:18964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212003.321871:0:18964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321879:0:18964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321887:0:18964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.321897:0:18964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788212003.321926:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3310:x1875075660898560:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212003.321933:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788212003.321973:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660898560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788212003.322328:0:19414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a6ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6cdf expref: 11 pid: 18973 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212003.322343:0:19414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19414:1875075660898432:0@lo:104: 00010000:00010000:3.0:1788212003.322357:0:19414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.322374:0:19414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.322380:0:19414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212003.322386:0:19414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4600/0x2afbce82f55a6d25 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212003.495458:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212004.517836:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788212004.845419:0:18976:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788212004.845440:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfd0b3f800 from 10 10000000:01000000:2.0:1788212004.845446:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788212004.845504:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212004.845517:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212004.845548:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212004.845588:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788212004.845680:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212004.845740:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788212004.846068:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898688 00000100:00100000:1.0:1788212004.846077:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898688 00000100:00100000:1.0:1788212004.846147:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788212004.846158:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+11:18976:x1875075660898688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788212004.846203:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212004.846224:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d2c expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212004.846251:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212004.846269:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212004.846280:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06000, rc 0) 00000100:00100000:1.0:1788212004.846341:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660898688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212004.846348:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788212004.846498:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212004.846515:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212004.846525:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212004.846610:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788212004.846653:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212004.846678:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212004.846694:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898816 00000100:00100000:0.0:1788212004.846698:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898816 00000100:00100000:0.0:1788212004.846718:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788212004.846724:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660898816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788212004.847033:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660898816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212004.847042:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788212004.847078:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788212004.847106:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788212004.847142:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212004.847156:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212004.847188:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660898944 00000100:00100000:0.0:1788212004.847192:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660898944 00000100:00100000:0.0:1788212004.847208:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788212004.847213:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660898944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788212004.847341:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:18976:x1875075660898944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212004.847348:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788212004.847599:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660898944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788212004.849052:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788212004.849541:0:18976:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788212004.849570:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788212004.849582:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212004.849594:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788212005.031389:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788212005.553712:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212006.565390:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212007.589328:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788212008.167871:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212008.167880:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788212008.167884:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212008.167887:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788212008.167928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788212008.168024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212008.168080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788212008.168087:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660899200:0@lo:400:kworker.0 00000100:00100000:2.0:1788212008.168116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212008.168154:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899200 00000100:00100000:2.0:1788212008.168183:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899200 00000100:00100000:2.0:1788212008.168234:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788212008.168493:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899072 00000100:00100000:0.0:1788212008.168498:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899072 00000100:00100000:0.0:1788212008.168532:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788212008.168540:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3308:x1875075660899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212008.168613:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:3308:x1875075660899072:12345-0@lo:400:kworker.0 Request processed in 74us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212008.168624:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788212008.168686:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788212008.169046:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660899200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212008.169108:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660899200:12345-0@lo:400:kworker.0 Request processed in 865us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212008.169116:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788212008.174915:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac001200000 x1875075660899200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212008.174935:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660899200:0@lo:400:kworker.0 00010000:00010000:3.0:1788212008.623770:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788212009.382755:0:19664:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788212009.382760:0:19664:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788212009.382876:0:19664:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abfe472b000 00000020:01000004:2.0:1788212009.382893:0:19664:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788212009.382905:0:19664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788212009.382917:0:19664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8abfd8360000) 00000020:00000080:2.0:1788212009.382932:0:19664:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788212009.421050:0:19664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788212009.422133:0:19664:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788212009.426893:0:19664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788212009.427142:0:19664:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788212009.428296:0:19664:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788212009.431507:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788212009.433307:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788212009.433994:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788212009.434831:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 676: rc = 0 00100000:10000000:2.0:1788212009.435368:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 676: rc = 0 00100000:10000000:2.0:1788212009.435767:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 676: rc = 0 00100000:10000000:2.0:1788212009.437774:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 676: rc = 0 00100000:10000000:2.0:1788212009.438223:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 676: rc = 0 00100000:10000000:2.0:1788212009.438633:0:19664:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 676: rc = 0 00000020:00000080:2.0:1788212009.439823:0:19664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788212009.439837:0:19664:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788212009.439849:0:19664:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a6d41 00000020:01000004:2.0:1788212009.439858:0:19664:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788212009.439884:0:19664:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788212009.439888:0:19664:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788212009.439896:0:19664:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788212009.439901:0:19664:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788212009.439915:0:19664:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8abfd8364d28) 00000020:00000080:2.0:1788212009.439925:0:19664:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788212009.442233:0:19664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788212009.442630:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788212009.442637:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788212009.458190:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788212009.458213:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788212009.459895:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788212009.459907:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788212009.464805:0:19664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788212009.465008:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788212009.465015:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788212009.465817:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788212009.465826:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788212009.506211:0:19664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788212009.506518:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788212009.506525:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788212009.509589:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788212009.509605:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788212009.517155:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788212009.517202:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788212009.520683:0:19664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788212009.520919:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788212009.520926:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788212009.522352:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788212009.522363:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788212009.578774:0:19664:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788212009.579090:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788212009.579098:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788212009.582344:0:19664:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788212009.582358:0:19664:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788212009.583045:0:19664:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788212009.583069:0:19664:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788212009.583076:0:19664:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788212009.598886:0:19664:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788212009.600700:0:19664:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788212009.600707:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788212009.600709:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788212009.600710:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212009.600711:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212009.600713:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212009.600714:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212009.600716:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212009.600717:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212009.600719:0:19664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788212009.600723:0:19664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788212009.600725:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788212009.600737:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788212009.600738:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212009.600739:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212009.600740:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212009.600741:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212009.600742:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212009.600743:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212009.600744:0:19664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788212009.600774:0:19664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788212009.600801:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899328:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788212009.600905:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.601058:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113780 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.601131:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899328 00000100:00100000:1.0:1788212009.601140:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899328 00000100:00100000:1.0:1788212009.601341:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788212009.601352:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19664:x1875075660899328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788212009.601404:0:18973:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788212009.601407:0:18973:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788212009.601416:0:18973:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788212009.609225:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19664:x1875075660899328:12345-0@lo:253:mount.lustre.0 Request processed in 7866us (8311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.609242:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788212009.609396:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899328:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788212009.609412:0:19664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788212009.609416:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788212009.609418:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788212009.609419:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212009.609420:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212009.609421:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212009.609423:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212009.609424:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212009.609426:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212009.609427:0:19664:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788212009.609445:0:19664:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfe472b000 from lustre-OST0000 10000000:01000000:3.0:1788212009.609470:0:19664:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788212009.609473:0:19664:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788212009.609479:0:19664:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abec66f4d28 local copy 00010000:00010000:3.0:1788212009.609490:0:19664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212009.609928:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212009.609987:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.610079:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113540 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.610985:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899456 00000100:00100000:0.0:1788212009.610995:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899456 00000100:00100000:0.0:1788212009.611045:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788212009.611053:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19664:x1875075660899456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788212009.611287:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19664:x1875075660899456:12345-0@lo:501:mount.lustre.0 Request processed in 233us (1299us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788212009.611302:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788212009.611893:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899456:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788212009.611921:0:19664:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788212009.612093:0:19664:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788212009.612102:0:19664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.612113:0:19664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788212009.612139:0:19664:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfe472b000 10000000:01000000:3.0:1788212009.612145:0:19664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788212009.612150:0:19664:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8abec66f4d28 10000000:01000000:3.0:1788212009.612153:0:19664:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788212009.612156:0:19664:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8abec66f4d28 from 1 10000000:01000000:3.0:1788212009.612159:0:19664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788212009.612361:0:19664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.612371:0:19664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.612382:0:19664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212009.612587:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788212009.612689:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.612728:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113540 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.612815:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899584 00000100:00100000:1.0:1788212009.612822:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899584 00000100:00100000:1.0:1788212009.612903:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788212009.612912:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+12:19664:x1875075660899584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788212009.612925:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212009.612938:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a6d56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d4f expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.612962:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a6d56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d4f expref: 13 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.612972:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06a00/0x2afbce82f55a6d56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d4f expref: 13 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.612981:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06a00, rc 0) 00000100:00100000:1.0:1788212009.613029:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+13:19664:x1875075660899584:12345-0@lo:101:mount.lustre.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.613035:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788212009.613101:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788212009.613113:0:19664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d56 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.613130:0:19664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d56 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788212009.613147:0:19664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788212009.613186:0:19664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d56 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.613194:0:19664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c4600/0x2afbce82f55a6d4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d56 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788212009.613203:0:19664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788212009.613207:0:19664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788212009.613212:0:19664:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788212009.613214:0:19664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788212009.613230:0:19664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.613238:0:19664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.613246:0:19664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212009.613258:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788212009.613284:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.613716:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113540 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.613816:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899712 00000100:00100000:0.0:1788212009.613822:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899712 00000100:00100000:0.0:1788212009.613864:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788212009.613872:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+13:19664:x1875075660899712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788212009.613882:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212009.613893:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030000/0x2afbce82f55a6d64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d5d expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.613912:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030000/0x2afbce82f55a6d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d5d expref: 14 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.613922:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030000/0x2afbce82f55a6d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d5d expref: 14 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.613928:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030000, rc 0) 00000100:00100000:0.0:1788212009.614015:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660899712:12345-0@lo:101:mount.lustre.0 Request processed in 143us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212009.614023:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788212009.614104:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788212009.614116:0:19664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d64 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.614135:0:19664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d64 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788212009.615773:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788212009.616919:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788212009.617448:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788212009.617496:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788212009.617531:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788212009.617618:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788212009.617658:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788212009.617687:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788212009.617730:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788212009.617783:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788212009.617817:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788212009.617876:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788212009.617914:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788212009.618228:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788212009.618302:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788212009.618311:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788212009.618505:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212009.618586:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.618679:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113480 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.618768:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899840 00000100:00100000:2.0:1788212009.618776:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899840 00000100:00100000:2.0:1788212009.618867:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788212009.618878:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660899840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212009.619256:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660899840:12345-0@lo:501:mount.lustre.0 Request processed in 379us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.619264:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788212009.619529:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212009.619578:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788212009.619631:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.619856:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113480 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.619930:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660899968 00000100:00100000:0.0:1788212009.619935:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660899968 00000100:00100000:1.0:1788212009.620154:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788212009.620189:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660899968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788212009.620509:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660899968:12345-0@lo:503:mount.lustre.0 Request processed in 347us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.620517:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788212009.620626:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660899968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788212009.621444:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788212009.621517:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788212009.621583:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.622098:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113480 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.622259:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900096 00000100:00100000:2.0:1788212009.622266:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900096 00000100:00100000:2.0:1788212009.622301:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788212009.622310:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660900096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788212009.622873:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660900096:12345-0@lo:502:mount.lustre.0 Request processed in 562us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.622883:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788212009.623333:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788212009.623696:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788212009.623758:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788212009.623791:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788212009.623840:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788212009.623876:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788212009.623909:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788212009.624022:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788212009.624081:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788212009.624115:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788212009.624159:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788212009.624223:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788212009.624270:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788212009.624308:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788212009.624365:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.624523:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffe113480 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.624587:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900224 00000100:00100000:1.0:1788212009.624601:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900224 00000100:00100000:1.0:1788212009.624697:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788212009.624707:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660900224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212009.624928:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660900224:12345-0@lo:502:mount.lustre.0 Request processed in 223us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.624936:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788212009.625097:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788212009.625198:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788212009.625209:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788212009.626142:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788212009.626151:0:19678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788212009.626157:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.626160:0:19678:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788212009.626516:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788212009.626543:0:19678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8abfd83619b8) 00000020:00000080:2.0:1788212009.626565:0:19678:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788212009.626573:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788212009.626818:0:19678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfe472b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788212009.626826:0:19678:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788212009.626833:0:19678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2afbce82f55a6d72 00010000:00010000:2.0:1788212009.630947:0:19678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788212009.631631:0:19678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:2.0:1788212009.633907:0:19678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788212009.636860:0:19678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788212009.636879:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788212009.636887:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212009.636890:0:19678:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788212009.636895:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788212009.636898:0:19678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788212009.636900:0:19678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788212009.636901:0:19678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788212009.636903:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788212009.636905:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212009.636907:0:19678:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788212009.636909:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788212009.636912:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212009.636913:0:19678:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788212009.636919:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788212009.636920:0:19678:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788212009.636922:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788212009.636924:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212009.636925:0:19678:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788212009.636927:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788212009.636929:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212009.636930:0:19678:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788212009.636932:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00010000:00010000:0.0:1788212009.644901:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788212009.646006:0:19678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788212009.646017:0:19678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788212009.646019:0:19678:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788212009.646026:0:19678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788212009.646306:0:19664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788212009.646334:0:19664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788212009.646409:0:19664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d64 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.646429:0:19664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc13c5600/0x2afbce82f55a6d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d64 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788212009.646438:0:19664:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfe472b000 from 1 10000000:01000000:1.0:1788212009.646441:0:19664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788212009.646482:0:19664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.646491:0:19664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.646502:0:19664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212009.646526:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788212009.646607:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212009.646648:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788212009.647033:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900352 00000100:00100000:3.0:1788212009.647060:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900352 00000100:00100000:3.0:1788212009.647114:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788212009.647125:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+14:19664:x1875075660900352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788212009.647138:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212009.647149:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d79 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.647195:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 15 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.647205:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 15 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.647213:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4200, rc 0) 00000100:00100000:3.0:1788212009.647256:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900352:12345-0@lo:101:mount.lustre.0 Request processed in 134us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212009.647263:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788212009.647365:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788212009.647399:0:19664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.647415:0:19664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788212009.647937:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788212009.648420:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788212009.648652:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788212009.648710:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788212009.648755:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788212009.648789:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788212009.648819:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788212009.648863:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788212009.648896:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788212009.648926:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788212009.649024:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788212009.649034:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788212009.649105:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788212009.649161:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212009.649225:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe477ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.649268:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900480 00000100:00100000:2.0:1788212009.649276:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900480 00000100:00100000:2.0:1788212009.649319:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788212009.649328:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212009.649681:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900480:12345-0@lo:501:mount.lustre.0 Request processed in 354us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.649702:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788212009.649874:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788212009.649926:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788212009.649979:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212009.649993:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2bfa300 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.650434:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900608 00000100:00100000:2.0:1788212009.650442:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900608 00000100:00100000:2.0:1788212009.650490:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788212009.650501:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788212009.650696:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900608:12345-0@lo:503:mount.lustre.0 Request processed in 197us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.650704:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788212009.650887:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788212009.653257:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788212009.653377:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212009.653456:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212009.653505:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2bfa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.653558:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900736 00000100:00100000:1.0:1788212009.653566:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900736 00000100:00100000:1.0:1788212009.653629:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788212009.653640:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212009.653859:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900736:12345-0@lo:502:mount.lustre.0 Request processed in 220us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.653868:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788212009.654984:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788212009.655903:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788212009.655967:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788212009.656015:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788212009.656589:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788212009.656643:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788212009.656699:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788212009.656737:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788212009.656772:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788212009.656823:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212009.657571:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212009.658123:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc2bfa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.658269:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900864 00000100:00100000:1.0:1788212009.658286:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900864 00000100:00100000:1.0:1788212009.658392:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788212009.658403:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212009.658679:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900864:12345-0@lo:502:mount.lustre.0 Request processed in 277us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.658688:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788212009.658782:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788212009.658942:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788212009.658956:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788212009.662320:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788212009.662344:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662347:0:19682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788212009.662355:0:19682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfe472b000 00000020:00000080:0.0:1788212009.662357:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788212009.662382:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788212009.662384:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662385:0:19682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788212009.662388:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788212009.662391:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662392:0:19682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788212009.662395:0:19682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfe472b000 00000020:00000080:0.0:1788212009.662397:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788212009.662464:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788212009.662468:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662584:0:19682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788212009.662591:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788212009.662595:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662596:0:19682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788212009.662600:0:19682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfe472b000 00000020:00000080:0.0:1788212009.662602:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788212009.662642:0:19682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788212009.662646:0:19682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788212009.662647:0:19682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788212009.662650:0:19682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788212009.664636:0:19664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788212009.664677:0:19664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788212009.664702:0:19664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.664716:0:19664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788212009.664773:0:19664:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788212009.664776:0:19664:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfe472b000 10000000:01000000:2.0:1788212009.664779:0:19664:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfe472b000 10000000:01000000:2.0:1788212009.664784:0:19664:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788212009.664790:0:19664:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfe472b000 from 1 10000000:01000000:2.0:1788212009.664792:0:19664:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788212009.664828:0:19664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.664837:0:19664:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.664847:0:19664:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212009.664880:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788212009.664952:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.666797:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.669634:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660900992 00000100:00100000:0.0:1788212009.669651:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660900992 00000100:00100000:0.0:1788212009.669706:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788212009.669716:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660900992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788212009.669732:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212009.669749:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a6d8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6d87 expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.669778:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a6d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6d87 expref: 16 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.669788:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030200/0x2afbce82f55a6d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d87 expref: 16 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.669804:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030200, rc 0) 00000100:00100000:0.0:1788212009.669884:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660900992:12345-0@lo:101:mount.lustre.0 Request processed in 169us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212009.669890:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788212009.670008:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660900992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788212009.670026:0:19664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d8e expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.670338:0:19664:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6d8e expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788212009.673805:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788212009.677863:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788212009.678246:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788212009.678292:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788212009.678329:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788212009.678376:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788212009.678414:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788212009.678464:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788212009.680634:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788212009.680686:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788212009.680767:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788212009.680805:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788212009.680837:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788212009.680905:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788212009.680943:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788212009.680994:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788212009.681271:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788212009.681326:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788212009.681358:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788212009.681576:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788212009.681617:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788212009.681652:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788212009.681702:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788212009.681739:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788212009.681772:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788212009.681819:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788212009.681857:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788212009.681891:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788212009.681941:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788212009.681978:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788212009.682013:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788212009.685665:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788212009.685729:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788212009.685765:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788212009.685797:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788212009.685844:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788212009.685882:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788212009.685928:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788212009.685966:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788212009.686000:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788212009.686593:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788212009.686641:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1788212009.686742:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1788212009.686750:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788212009.686866:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212009.686940:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.686994:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788212009.687148:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901120 00000100:00100000:1.0:1788212009.687157:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901120 00000100:00100000:1.0:1788212009.687223:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788212009.687233:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788212009.687484:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901120:12345-0@lo:501:mount.lustre.0 Request processed in 238us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.687492:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788212009.690775:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212009.690837:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788212009.690918:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.690963:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901248 00000100:00100000:2.0:1788212009.690970:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901248 00000100:00100000:0.0:1788212009.691069:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788212009.691084:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788212009.691309:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901248:12345-0@lo:503:mount.lustre.0 Request processed in 228us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212009.691317:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788212009.692806:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.692848:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788212009.696783:0:19664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788212009.696927:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788212009.697030:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.698620:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.698750:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901376 00000100:00100000:0.0:1788212009.698759:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901376 00000100:00100000:0.0:1788212009.698811:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788212009.698822:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212009.699107:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901376:12345-0@lo:502:mount.lustre.0 Request processed in 286us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212009.699115:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788212009.699187:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788212009.699484:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788212009.699585:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788212009.699620:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788212009.699668:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788212009.699700:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788212009.699743:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788212009.699776:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788212009.699810:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788212009.699869:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788212009.699903:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788212009.699930:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788212009.699972:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788212009.700004:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788212009.700055:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788212009.700105:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788212009.700138:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788212009.700199:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788212009.700267:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788212009.700302:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788212009.700347:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788212009.700396:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788212009.700432:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788212009.700466:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788212009.700511:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788212009.700561:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1788212009.700595:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1788212009.700640:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1788212009.700676:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1788212009.700709:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1788212009.700757:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1788212009.700792:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1788212009.700826:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1788212009.700861:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1788212009.700927:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1788212009.700969:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1788212009.701019:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1788212009.701056:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1788212009.701096:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1788212009.701141:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1788212009.701203:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1788212009.701255:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788212009.701330:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.701386:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901504 00000100:00100000:2.0:1788212009.701393:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901504 00000100:00100000:2.0:1788212009.701443:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788212009.701451:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788212009.701667:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901504:12345-0@lo:502:mount.lustre.0 Request processed in 214us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.701674:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788212009.701722:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788212009.701743:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788212009.701809:0:19664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788212009.701819:0:19664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788212009.716398:0:19687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788212009.716427:0:19687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8abec67599b8) 00000020:00000080:2.0:1788212009.716448:0:19687:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788212009.716552:0:19687:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfe472b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788212009.716557:0:19687:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfe472b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788212009.716559:0:19687:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfe472b000 3 00010000:00080000:2.0:1788212009.716595:0:19687:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abff600a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1788212009.730712:0:19687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788212009.730998:0:19687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788212009.731058:0:19687:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788212009.731075:0:19687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2afbce82f55a6d9c 00000100:00080000:2.0:1788212009.731088:0:19687:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788212009.731095:0:19687:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8abff600a000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1788212009.731148:0:19687:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac001200700 x1875075660901632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788212009.731208:0:19687:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788212009.732241:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660901632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788212009.732336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.732777:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901632 00000100:00100000:2.0:1788212009.732785:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901632 00000100:00100000:2.0:1788212009.732836:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788212009.732846:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875075660901632:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788212009.732881:0:18980:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1788212009.732931:0:18980:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2afbce82f55a6da3 00000004:00100000:2.0:1788212009.732947:0:18980:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788212009.732983:0:18980:0:(import.c:65:import_set_state_nolock()) ffff8abff600a800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788212009.733022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788212009.733028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788212009.733031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788212009.733035:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788212009.733067:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875075660901632:12345-0@lo:38:llog_process_th.0 Request processed in 221us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.733076:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788212009.733095:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660901760:0@lo:400:kworker.0 00000100:00100000:1.0:1788212009.733137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788212009.733413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001200700 x1875075660901632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788212019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212009.733430:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788212009.733439:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788212009.733448:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788212009.733453:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788212009.733456:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abff600a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788212009.733462:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875075660901632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788212009.733493:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901760 00000100:00100000:2.0:1788212009.733498:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901760 00000100:00100000:2.0:1788212009.733527:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788212009.733545:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212009.733595:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660901760:12345-0@lo:400:kworker.0 Request processed in 61us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212009.733601:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788212009.733706:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001242d80 x1875075660901760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212009.733717:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660901760:0@lo:400:kworker.0 00000040:00080000:2.0:1788212009.733806:0:19687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1788212009.740309:0:19664:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788212009.741254:0:19664:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788212009.741276:0:19664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d8e expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.741287:0:19664:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80400/0x2afbce82f55a6d87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6d8e expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788212009.742000:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788212009.742003:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788212009.742005:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788212009.742006:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788212009.742007:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788212009.742010:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788212009.742011:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788212009.742013:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788212009.742015:0:19664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788212009.742019:0:19664:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788212009.742022:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788212009.742023:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788212009.742024:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788212009.742026:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788212009.742027:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788212009.742027:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788212009.742029:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788212009.742030:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788212009.742031:0:19664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788212009.743073:0:19664:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788212009.743095:0:19664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788212009.743285:0:19664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212009.743436:0:19664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe6fc6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.746766:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660901888 00000100:00100000:0.0:1788212009.746781:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660901888 00000100:00100000:0.0:1788212009.747020:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788212009.747034:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:19664:x1875075660901888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788212009.747274:0:18973:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788212009.747290:0:18973:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788212009.811874:0:18973:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788212009.811897:0:18973:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788212009.811988:0:18995:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788212009.811995:0:18995:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788212009.812027:0:18995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812052:0:18995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 16 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812063:0:18995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812115:0:18995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 16 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812161:0:18995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 16 pid: 18973 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212009.812237:0:18995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660902016:0@lo:104: 00000100:00100000:3.0:1788212009.812320:0:18995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.812370:0:18995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfe4bfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788212009.812420:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902016 00000100:00100000:0.0:1788212009.812429:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902016 00000100:00100000:0.0:1788212009.812477:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788212009.812487:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660902016:12345-0@lo:104: 00010000:00010000:0.0:1788212009.812501:0:18962:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212009.812582:0:18962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788212009.812589:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660902016:12345-0@lo:104: Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212009.812597:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788212009.812690:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212009.812696:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812705:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc0031e00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:3.0:1788212009.812710:0:18968:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812720:0:18968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788212009.812727:0:18968:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788212009.812733:0:18968:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788212009.812771:0:18968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812778:0:18968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788212009.812816:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212009.812823:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfc0031e00/0x2afbce82f55a6d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d17 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212009.812828:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660902144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788212009.812848:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212009.812849:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212009.812851:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212009.812858:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212009.812876:0:18995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660902016:0@lo:104: 00010000:00010000:3.0:1788212009.812894:0:18995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212009.812927:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902144 00000100:00100000:1.0:1788212009.812931:0:18964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902144 00010000:00010000:1.0:1788212009.813077:0:18964:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 17 pid: 18973 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212009.813145:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788212009.813152:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:3311:x1875075660902144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788212009.813163:0:18964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788212009.813191:0:18964:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 17 pid: 18973 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813202:0:18964:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 17 pid: 18973 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813215:0:18964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4000/0x2afbce82f55a6d17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6d10 expref: 17 pid: 18973 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813229:0:18964:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813237:0:18964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788212009.813252:0:18964:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002421669s 00010000:00010000:1.0:1788212009.813257:0:18964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813264:0:18964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813271:0:18964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813278:0:18964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813290:0:18964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212009.813295:0:18964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813302:0:18964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813328:0:18964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212009.813338:0:18964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788212009.813373:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3311:x1875075660902144:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.813381:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788212009.814247:0:18995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.814259:0:18995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212009.814265:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a6daa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212009.814305:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660902144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788212009.828551:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:19664:x1875075660901888:12345-0@lo:253:mount.lustre.0 Request processed in 81499us (85245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212009.828572:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788212009.828774:0:19664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:19664:1875075660901888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788212009.828791:0:19664:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788212009.828795:0:19664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788212009.828797:0:19664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788212009.828798:0:19664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788212009.828800:0:19664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788212009.828801:0:19664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788212009.828802:0:19664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788212009.828803:0:19664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788212009.828805:0:19664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788212009.828806:0:19664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788212009.828821:0:19664:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788212009.830231:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212009.830467:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788212009.830812:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212009.831036:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788212009.831490:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212009.831686:0:19664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788212009.834453:0:19664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788212009.861597:0:19664:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788212009.861608:0:19664:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788212009.861650:0:19664:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788212009.862036:0:19664:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788212009.862055:0:19664:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788212009.862085:0:19664:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788212010.668358:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788212011.365318:0:18976:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788212011.365327:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfd0b3f800 from 10 10000000:01000000:1.0:1788212011.365332:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788212011.365387:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212011.365400:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212011.365412:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212011.365455:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660902272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788212011.365543:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212011.365607:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd04f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212011.366394:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902272 00000100:00100000:0.0:1788212011.366403:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902272 00000100:00100000:0.0:1788212011.366465:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788212011.366477:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+15:18976:x1875075660902272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212011.366491:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212011.366520:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6db1 expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212011.366557:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 16 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212011.366568:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 16 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212011.366576:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030c00, rc 0) 00000100:00100000:0.0:1788212011.366645:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:18976:x1875075660902272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212011.366652:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788212011.367438:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660902272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788212011.367462:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212011.367473:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212011.367561:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660902400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788212011.367610:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212011.367650:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd04f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788212011.367719:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902400 00000100:00100000:3.0:1788212011.367725:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902400 00000100:00100000:3.0:1788212011.367780:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788212011.367799:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:18976:x1875075660902400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788212011.367817:0:18973:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788212011.367836:0:18973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788212011.367839:0:18973:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788212011.367932:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:18976:x1875075660902400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212011.367940:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788212011.368214:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660902400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788212011.368274:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788212011.368282:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212011.368304:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212011.685532:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212012.711198:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212013.737005:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212014.759033:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788212014.821335:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212014.821342:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788212014.821345:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788212014.821349:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788212014.821401:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660902784:0@lo:400:kworker.0 00000100:00100000:2.0:1788212014.821484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212014.821556:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902784 00000100:00100000:2.0:1788212014.821563:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902784 00000100:00100000:2.0:1788212014.821612:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788212014.821620:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660902784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788212014.822073:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660902656:0@lo:400:kworker.0 00000100:00100000:1.0:1788212014.822114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212014.822148:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788212014.822184:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660902528:0@lo:400:kworker.0 00000100:00100000:1.0:1788212014.822215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212014.823006:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660902784:12345-0@lo:400:kworker.0 Request processed in 1382us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212014.823019:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788212014.823112:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902656 00000100:00100000:2.0:1788212014.823119:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902656 00000100:00080000:0.0:1788212014.823150:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212014.823160:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788212014.823196:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212014.823244:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875075660902656:12345-0@lo:400:kworker.0 Request processed in 51us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212014.823250:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788212014.823273:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902528 00000100:00100000:2.0:1788212014.823276:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902528 00010000:00080000:1.0:1788212014.823423:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001201500 x1875075660902784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212014.823457:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660902784:0@lo:400:kworker.0 00000100:00100000:2.0:1788212014.823833:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788212014.823902:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3309:x1875075660902528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212014.823939:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3309:x1875075660902528:12345-0@lo:400:kworker.0 Request processed in 41us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212014.823945:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788212014.828932:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660902528:0@lo:400:kworker.0 00010000:00080000:2.0:1788212014.828961:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001202680 x1875075660902656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212014.828974:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875075660902656:0@lo:400:kworker.0 00000040:00080000:0.0:1788212015.270229:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788212015.785599:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212016.806488:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788212017.646849:0:20034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788212017.831146:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212018.858412:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212018.981627:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788212003/real 1788212003] req@ffff8ac001203b80 x1875075660898048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212018.981666:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac001203b80 x1875075660898048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212018.981677:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788212003/real 1788212003] req@ffff8ac001201c00 x1875075660898176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212018.981688:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac001201c00 x1875075660898176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788212018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788212018.981705:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfc542d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788212018.981743:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788212018.981748:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660898048:0@lo:8:kworker.0 00000100:00080000:0.0:1788212018.981754:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788212018.981760:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788212018.981763:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660898176:0@lo:8:kworker.0 00000100:00080000:3.0:1788212018.982681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788212018.982687:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788212018.982690:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abfc542d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788212018.982695:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 592 00000100:00080000:3.0:1788212018.982707:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788212018.982713:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8abfc542d000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788212018.982742:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9a8e00 x1875075660903040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788212018.982757:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788212018.982760:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788212018.982762:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788212018.982765:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 592 00000100:00080000:3.0:1788212018.982780:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788212018.982785:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788212018.982799:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9a9c00 x1875075660903168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788212018.982847:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788212018.982863:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660902912:0@lo:400:kworker.0 00000100:00100000:3.0:1788212018.982955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212018.983631:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660903040:0@lo:8:kworker.0 00000100:00100000:0.0:1788212018.983679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212018.983707:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660903168:0@lo:8:kworker.0 00000100:00100000:0.0:1788212018.983728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212018.983761:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660903296:0@lo:400:kworker.0 00000100:00100000:0.0:1788212018.983862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212018.983885:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788212018.983891:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660903424:0@lo:400:kworker.0 00000100:00100000:0.0:1788212018.983911:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212018.983945:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660902912 00000100:00100000:0.0:1788212018.983954:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660902912 00000100:00100000:0.0:1788212018.984008:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788212018.984019:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3310:x1875075660902912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212018.984077:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3310:x1875075660902912:12345-0@lo:400:kworker.0 Request processed in 59us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212018.984085:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788212018.984124:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903040 00000100:00100000:0.0:1788212018.984127:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903040 00000100:00100000:0.0:1788212018.984146:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903168 00000100:00100000:0.0:1788212018.984149:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903168 00000100:00100000:0.0:1788212018.984158:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788212018.984193:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875075660903040:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788212018.984219:0:19667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:0.0:1788212018.984266:0:19667:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6dbf 00002000:00100000:0.0:1788212018.984284:0:19667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8abfcacbe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788212018.984289:0:19667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788212018.984292:0:19667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788212018.986123:0:19667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788212018.986185:0:19667:0:(import.c:65:import_set_state_nolock()) ffff8abfcacbd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788212018.986305:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660903040:12345-0@lo:8:kworker.0 Request processed in 2109us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212018.986316:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788212018.986347:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788212018.986365:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875075660903168:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788212018.986380:0:19667:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788212019.009888:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903296 00000100:00100000:1.0:1788212019.009907:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903296 00000100:00100000:1.0:1788212019.009973:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903424 00000100:00100000:1.0:1788212019.009977:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903424 00000100:00100000:1.0:1788212019.010013:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788212019.010023:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660903296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788212019.010125:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660903296:12345-0@lo:400:kworker.0 Request processed in 103us (26262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212019.010134:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788212019.010156:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788212019.010183:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660903424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788212019.010218:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660903424:12345-0@lo:400:kworker.0 Request processed in 56us (26305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212019.010224:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788212019.013898:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef9a8e00 x1875075660903040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788212038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212019.013913:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788212019.013923:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788212019.013933:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788212019.013939:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788212019.013949:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abfc542d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788212019.013966:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788212019.013972:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660903040:0@lo:8:kworker.0 00000100:00100000:1.0:1788212019.014014:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660902912:0@lo:400:kworker.0 00010000:00080000:1.0:1788212019.020732:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef9a9180 x1875075660903424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212019.020750:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660903424:0@lo:400:kworker.0 00010000:00080000:1.0:1788212019.020766:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef9aaa00 x1875075660903296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212019.020811:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660903296:0@lo:400:kworker.0 00000100:00080000:1.0:1788212019.020848:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788212019.023814:0:19002:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:1.0:1788212019.023848:0:19002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19002:1875075660903680:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788212019.023925:0:19002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212019.023974:0:19002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca4a0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788212019.023989:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788212019.024002:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660903552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788212019.024029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212019.024068:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788212019.024076:0:19665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788212019.024126:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903552 00000100:00100000:1.0:1788212019.024134:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903552 00000100:00100000:1.0:1788212019.024209:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788212019.024220:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660903552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788212019.024254:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788212019.024309:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875075660903552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212019.024316:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788212019.024340:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788212019.024380:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac001240000 x1875075660903552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788212035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212019.024398:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660903552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788212019.031414:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903680 00000100:00100000:1.0:1788212019.031429:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903680 00000100:00100000:3.0:1788212019.031616:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788212019.031630:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19002:x1875075660903680:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788212019.032637:0:19001:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788212019.032882:0:19001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 608338715110ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788212019.048761:0:20100:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788212019.048773:0:20100:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788212019.048779:0:20100:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:1.0:1788212019.058142:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875075660903168:12345-0@lo:8:kworker.0 Request processed in 71780us (74404us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788212019.058159:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788212019.058247:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788212019.058253:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788212019.058257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660903168:0@lo:8:kworker.0 00002000:00010000:3.0:1788212019.079450:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.079465:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.079483:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.079494:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.079502:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082607:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082632:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082641:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082664:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.082680:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.082686:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082693:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.082698:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082707:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082724:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082742:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6dc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.082767:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.082780:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.082782:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.083452:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.083460:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083473:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.083478:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.083484:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083495:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083503:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083510:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083529:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.083538:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.083548:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083556:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.083560:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083568:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.083580:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.085858:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6dcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.085902:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.085904:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.085907:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.086688:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.086697:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.086712:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.086716:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.086723:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.086749:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.086759:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.086954:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.086985:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.087004:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.087010:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.087018:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.087023:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.087032:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.087051:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.087057:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6dd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.087083:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.087085:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.087086:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.093532:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.093545:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093562:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.093567:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.093574:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093589:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093599:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093607:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093624:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.093634:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.093639:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093658:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.093664:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093673:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093690:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093698:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6ddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.093716:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.093718:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.093719:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.094051:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.094058:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094067:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.094070:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.094074:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094083:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094096:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094103:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094117:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.094124:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.094129:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094136:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.094139:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094147:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094157:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094186:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6de2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094200:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.094206:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.094207:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.094569:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.094575:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094583:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.094586:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.094591:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094600:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094608:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094615:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094627:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.094633:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.094636:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094642:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.094646:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094664:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094674:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094681:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.094694:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.094696:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.094697:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.095928:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.095937:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.095950:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.095954:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.095959:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.095970:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.095978:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.095990:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096005:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.096015:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.096019:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096026:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.096031:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096039:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096051:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096058:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6df0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.096073:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.096074:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.096076:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.097971:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.097992:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098007:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.098010:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.098016:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098028:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098037:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098044:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098063:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.098076:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.098081:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098088:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.098093:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098101:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098122:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098128:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.098148:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.098150:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.098152:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.102595:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.102608:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.102624:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.102628:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.102635:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.102649:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.102659:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.102667:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.102702:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.103467:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.103475:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.103485:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.103488:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.103492:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.103501:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.103509:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.103715:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.103891:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788212019.105234:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.105243:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.105257:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.105267:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.105273:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.105285:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.105294:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.105302:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.105975:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788212019.105986:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.105996:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.106001:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106010:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106032:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106047:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106070:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212019.106073:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106079:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.106082:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106088:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106097:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106102:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106110:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.106113:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106118:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.106127:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106134:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106143:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.106151:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.106152:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.106154:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788212019.107278:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788212019.108275:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.108288:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212019.110141:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.110153:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.110200:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.110206:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.110213:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.110227:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.110244:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.110252:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.110287:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788212019.110686:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788212019.110694:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.110702:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212019.110707:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.110727:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.110745:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.110752:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.110792:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212019.110794:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212019.110796:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.112048:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.112060:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112074:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.112078:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.112083:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112095:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112105:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112113:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112217:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.112718:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.112724:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112734:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.112737:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.112741:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112750:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112758:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.112764:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116044:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788212019.116059:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116075:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37aa00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212019.116080:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116091:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116117:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116143:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2be36c4/0x2afbce82f55a6e1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116201:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788212019.116206:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116213:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212019.116217:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116224:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116234:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.116240:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212019.116242:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212019.116244:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.119705:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.119726:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c77a38/0x2afbce82f55a6e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212019.121479:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.122911:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.122927:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.122955:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.122960:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.122967:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.122983:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.122996:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.123005:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.123039:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788212019.123643:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.123651:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.123660:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ba00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.123665:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.123675:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.123694:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.123702:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000814e5fa7/0x2afbce82f55a6e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.123734:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.123736:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.123738:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.124635:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.125099:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.125110:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.125125:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.125129:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.125135:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.125147:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.125206:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.125214:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.125230:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788212019.126743:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.126754:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.126765:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ac00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.126842:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.126853:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.126874:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.126881:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c359a9/0x2afbce82f55a6e2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.126901:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.126903:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.126905:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.128739:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.128752:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.128877:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.128883:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.128891:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.128906:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.128917:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.128925:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.129614:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.130253:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.130262:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.130276:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.130280:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.130285:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.130297:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.130306:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.130313:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132679:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788212019.132695:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132709:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.132714:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132746:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132830:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132839:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6e24c38/0x2afbce82f55a6e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132865:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212019.132869:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132874:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.132877:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132884:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132892:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.132899:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.132900:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.132907:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.133004:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.133011:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000decfef02/0x2afbce82f55a6e3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.133867:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.134981:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.134991:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135013:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.135018:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.135024:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135038:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135049:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135058:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135116:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.135663:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.135670:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135680:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.135683:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.135687:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135697:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135715:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.135722:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.138257:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212019.138272:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.138298:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.138304:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.138314:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.138336:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.138343:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c1ac07/0x2afbce82f55a6e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.139517:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212019.139527:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.139537:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.139542:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.139551:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.139566:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.139577:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.139579:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.139581:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.142360:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.142374:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bee7479/0x2afbce82f55a6e4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212019.143264:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.143273:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.143288:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.143293:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.143300:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.143314:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.143324:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.143345:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.143482:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212019.143489:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.143498:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37b000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.143502:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.143510:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.143603:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.143612:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.143614:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.143616:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.143868:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.143874:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099fbf00d/0x2afbce82f55a6e52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212019.144428:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.144434:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.144444:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.144447:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.144451:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.144460:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.144467:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.144473:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.144500:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788212019.144879:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.144886:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.144896:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37a800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.144900:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.144909:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.144925:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.144940:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5aad99e/0x2afbce82f55a6e59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.144958:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.144960:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.144961:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.146161:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.146201:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146216:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.146221:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.146227:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146237:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146246:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146254:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146275:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212019.146285:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212019.146290:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146297:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfcb37ae00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212019.146308:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146316:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146328:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146335:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8336448/0x2afbce82f55a6e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.146361:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.146364:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.146365:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.146632:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.147153:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.147161:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.147834:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.147840:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.147848:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.147863:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.147873:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.147890:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.147983:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.148626:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.148635:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.148646:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.148650:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.148654:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.148664:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.148674:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.148682:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.148920:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212019.148932:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.148942:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.148948:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.148958:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.148975:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.148982:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009960165e/0x2afbce82f55a6e67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.149004:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.149007:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.149023:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.149026:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.149034:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.149042:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.149049:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.149051:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.149052:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.149277:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.149282:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e33fe802/0x2afbce82f55a6e6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.149599:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212019.149997:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.150004:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150015:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.150018:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.150023:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150034:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150042:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150050:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150071:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.150582:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.150589:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150599:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.150601:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.150611:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150621:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150629:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150636:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.150692:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788212019.151137:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.151143:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.151152:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.151156:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.151159:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.151196:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.151205:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.151223:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151362:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788212019.151370:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151379:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.151383:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151393:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151409:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151417:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab057fe1/0x2afbce82f55a6e75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151435:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788212019.151445:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151452:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.151455:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151463:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151474:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151481:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b617092b/0x2afbce82f55a6e7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151493:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212019.151497:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151502:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212019.151505:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151521:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151543:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212019.151550:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.151552:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.151554:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.152845:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.152854:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cf4f9c/0x2afbce82f55a6e83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212019.153454:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.153461:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.153473:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.153476:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.153482:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.153493:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.153501:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.153508:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.154706:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.155454:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.155465:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.155481:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.155485:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.155493:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.155507:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156641:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.156651:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156661:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.156667:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156679:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156707:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156725:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000581a5587/0x2afbce82f55a6e8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.156755:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.156758:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.156760:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.156933:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.156942:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.157859:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212019.159739:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212019.159751:0:20100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.159778:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=608s v=(0 0) 00010000:00010000:3.0:1788212019.159790:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212019.159797:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.159811:0:20100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.159821:0:20100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212019.159829:0:20100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162721:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212019.162735:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162750:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.162756:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162778:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162800:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162809:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052043f28/0x2afbce82f55a6e91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162831:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212019.162835:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162852:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212019.162855:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162862:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162871:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212019.162878:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.162880:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212019.162882:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212019.163020:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212019.166475:0:20100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212019.166497:0:20100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd75bc71/0x2afbce82f55a6e98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788212019.168730:0:20100:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:3.0:1788212019.168970:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19002:x1875075660903680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 137340us (145041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212019.168981:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788212019.169087:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212019.169250:0:19002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19002:1875075660903680:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788212019.169267:0:19002:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:0.0:1788212019.169394:0:19002:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19002:1875075660903808:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788212019.169437:0:19002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212019.169486:0:19002:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788212019.170279:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903808 00000100:00100000:1.0:1788212019.170361:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903808 00000100:00100000:1.0:1788212019.170455:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212019.170466:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19002:x1875075660903808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788212019.170508:0:19665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1788212019.186501:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:19002:x1875075660903808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16020us (17046us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788212019.186948:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212019.187043:0:19002:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19002:1875075660903808:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788212019.187062:0:19002:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:1.0:1788212019.878966:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788212020.566206:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788212020.566233:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:0.0:1788212020.911417:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212021.925717:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212022.949461:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212023.974545:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788212024.037754:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788212024.037761:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788212024.037764:0:36:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788212024.037773:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:3.0:1788212024.037779:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788212024.037795:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788212024.037821:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9abb80 x1875075660904192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788212024.037873:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660904448:0@lo:400:kworker.0 00000100:00100000:3.0:1788212024.037963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212024.038068:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788212024.038075:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660903936:0@lo:400:kworker.0 00000100:00100000:3.0:1788212024.038105:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212024.038136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660904064:0@lo:400:kworker.0 00000100:00100000:3.0:1788212024.038188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212024.038213:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788212024.038219:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660904320:0@lo:400:kworker.0 00000100:00100000:3.0:1788212024.038240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212024.038285:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660904192:0@lo:8:kworker.0 00000100:00100000:3.0:1788212024.038314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212024.038381:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904064 00000100:00100000:0.0:1788212024.038393:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904064 00000100:00100000:0.0:1788212024.038460:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904192 00000100:00100000:0.0:1788212024.038463:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904192 00000100:00100000:0.0:1788212024.038493:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788212024.038502:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660904064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212024.038564:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660904064:12345-0@lo:400:kworker.0 Request processed in 64us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212024.038574:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788212024.038603:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788212024.038607:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3307:x1875075660904192:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788212024.038629:0:20100:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788212024.039108:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660903936 00000100:00100000:2.0:1788212024.039113:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660903936 00000100:00100000:2.0:1788212024.039145:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788212024.039152:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3310:x1875075660903936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212024.039222:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3310:x1875075660903936:12345-0@lo:400:kworker.0 Request processed in 70us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212024.039236:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788212024.039314:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660903936:0@lo:400:kworker.0 00000100:00100000:2.0:1788212024.041488:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904448 00000100:00100000:2.0:1788212024.041503:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904448 00000100:00100000:2.0:1788212024.041551:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904320 00000100:00100000:2.0:1788212024.041554:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904320 00000100:00100000:2.0:1788212024.041575:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788212024.041584:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660904448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212024.041682:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660904448:12345-0@lo:400:kworker.0 Request processed in 97us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212024.041689:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788212024.041706:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788212024.041712:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660904320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212024.041742:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660904320:12345-0@lo:400:kworker.0 Request processed in 30us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212024.041747:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788212024.041792:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef9a8000 x1875075660904448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212024.041810:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660904448:0@lo:400:kworker.0 00000100:00100000:2.0:1788212024.041833:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788212024.041845:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660904576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788212024.041883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212024.041938:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904576 00000100:00100000:2.0:1788212024.041942:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904576 00000100:00100000:2.0:1788212024.041983:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788212024.042001:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660904576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788212024.042035:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788212024.042080:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660904576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212024.042087:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788212024.042120:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788212024.042139:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660904576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788212024.058273:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788212024.058285:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788212024.058396:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abfef9a8a80 x1875075660904320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212024.058416:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660904320:0@lo:400:kworker.0 00000100:00100000:0.0:1788212024.058435:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660904064:0@lo:400:kworker.0 00000100:00100000:0.0:1788212024.058554:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3307:x1875075660904192:12345-0@lo:8:kworker.0 Request processed in 19943us (20237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788212024.058566:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788212024.062298:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788212024.062313:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788212024.062318:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660904192:0@lo:8:kworker.0 00010000:00010000:3.0:1788212025.000743:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788212025.511025:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788212025.991553:0:20389:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788212025.991557:0:20389:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788212025.991816:0:20389:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8abfe472e000 00000020:01000004:3.0:1788212025.991835:0:20389:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788212025.991852:0:20389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788212025.991871:0:20389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8abff7024d28) 00000020:00000080:3.0:1788212025.991891:0:20389:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788212026.015915:0:20389:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788212026.017554:0:20389:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788212026.020193:0:20389:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788212026.022033:0:20389:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788212026.022762:0:20389:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788212026.023111:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 203: rc = 0 00100000:10000000:2.0:1788212026.024893:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 203: rc = 0 00100000:10000000:2.0:1788212026.025049:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 203: rc = 0 00100000:10000000:2.0:1788212026.026196:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 457: rc = 0 00010000:00010000:1.0:1788212026.027745:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788212026.028901:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:2.0:1788212026.030105:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:2.0:1788212026.030797:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 457: rc = 0 00100000:10000000:2.0:1788212026.031068:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 457: rc = 0 00100000:10000000:2.0:1788212026.031575:0:20389:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 457: rc = 0 00000020:00000080:2.0:1788212026.032275:0:20389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788212026.032289:0:20389:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788212026.032577:0:20389:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a6ea6 00000020:01000004:2.0:1788212026.032590:0:20389:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788212026.032614:0:20389:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788212026.032623:0:20389:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788212026.032629:0:20389:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788212026.032724:0:20389:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788212026.032730:0:20389:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788212026.043885:0:20389:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788212026.043952:0:20389:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788212026.043958:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788212026.043960:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788212026.043961:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212026.043962:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212026.043964:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212026.043965:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212026.043967:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212026.043970:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212026.043972:0:20389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788212026.043977:0:20389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788212026.043979:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788212026.043981:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788212026.043982:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212026.043983:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212026.043984:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212026.043985:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212026.043986:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212026.043988:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212026.043989:0:20389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788212026.044030:0:20389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788212026.044064:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788212026.044227:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.044318:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc99a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788212026.044922:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904704 00000100:00100000:1.0:1788212026.044934:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904704 00000100:00100000:1.0:1788212026.045010:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788212026.045038:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:20389:x1875075660904704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788212026.045097:0:18973:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788212026.045101:0:18973:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788212026.045105:0:18973:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788212026.058604:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:20389:x1875075660904704:12345-0@lo:253:mount.lustre.0 Request processed in 13554us (14374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.058625:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788212026.058753:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788212026.058776:0:20389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788212026.058780:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788212026.058782:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788212026.058784:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788212026.058785:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788212026.058786:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788212026.058788:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788212026.058790:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788212026.058792:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788212026.058793:0:20389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788212026.058826:0:20389:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8abfe472e000 from lustre-OST0001 10000000:01000000:3.0:1788212026.058861:0:20389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788212026.058883:0:20389:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788212026.058895:0:20389:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8abec66f4d28 local copy 00010000:00010000:3.0:1788212026.058909:0:20389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212026.059189:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212026.060470:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.060520:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6574480 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.060698:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904832 00000100:00100000:0.0:1788212026.060709:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904832 00000100:00100000:0.0:1788212026.060766:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788212026.060776:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:20389:x1875075660904832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212026.061565:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788212026.061594:0:20389:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788212026.061803:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:20389:x1875075660904832:12345-0@lo:501:mount.lustre.0 Request processed in 1027us (1341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788212026.061823:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 10000000:01000000:2.0:1788212026.067058:0:20389:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788212026.067078:0:20389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.067096:0:20389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80200/0x2afbce82f55a6c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6c3e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788212026.067141:0:20389:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8abfe472e000 10000000:01000000:2.0:1788212026.067148:0:20389:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788212026.067156:0:20389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788212026.067160:0:20389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788212026.067183:0:20389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788212026.067186:0:20389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788212026.067255:0:20389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.067265:0:20389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.067280:0:20389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212026.067315:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788212026.067416:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212026.067466:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcac7a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.067673:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660904960 00000100:00100000:0.0:1788212026.067684:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660904960 00000100:00100000:0.0:1788212026.067744:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788212026.067755:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:20389:x1875075660904960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788212026.067769:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212026.067784:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0031e00/0x2afbce82f55a6eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6ead expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.067808:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0031e00/0x2afbce82f55a6eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6ead expref: 17 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.067820:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0031e00/0x2afbce82f55a6eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6ead expref: 17 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.067831:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031e00, rc 0) 00000100:00100000:0.0:1788212026.067897:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660904960:12345-0@lo:101:mount.lustre.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.067905:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788212026.068070:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660904960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788212026.068085:0:20389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6eb4 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.068095:0:20389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6eb4 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788212026.068850:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788212026.069730:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788212026.069972:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788212026.070016:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788212026.070051:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788212026.070104:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788212026.070140:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788212026.070204:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788212026.070271:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788212026.070305:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788212026.070346:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788212026.070417:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788212026.070433:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788212026.070520:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788212026.070580:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.070612:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff6574cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788212026.070890:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905088 00000100:00100000:2.0:1788212026.070904:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905088 00000100:00100000:2.0:1788212026.070964:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788212026.070974:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212026.071481:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905088:12345-0@lo:501:mount.lustre.0 Request processed in 506us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212026.071490:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788212026.071744:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788212026.071792:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788212026.071837:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.071875:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788212026.071943:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905216 00000100:00100000:2.0:1788212026.071948:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905216 00000100:00100000:2.0:1788212026.072101:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788212026.072109:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788212026.072461:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905216:12345-0@lo:503:mount.lustre.0 Request processed in 352us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212026.072469:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788212026.072643:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905216:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788212026.077196:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788212026.077544:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212026.077636:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.087264:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.087583:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905344 00000100:00100000:0.0:1788212026.087597:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905344 00000100:00100000:0.0:1788212026.087907:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788212026.087921:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212026.088502:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905344:12345-0@lo:502:mount.lustre.0 Request processed in 583us (10862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.088514:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788212026.088763:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788212026.089346:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788212026.089410:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788212026.089445:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788212026.089493:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788212026.089530:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788212026.089565:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788212026.089616:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788212026.090815:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788212026.090890:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788212026.090957:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212026.091708:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.091813:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.092595:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905472 00000100:00100000:3.0:1788212026.092613:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905472 00000100:00100000:2.0:1788212026.095222:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788212026.095245:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788212026.095522:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905472:12345-0@lo:502:mount.lustre.0 Request processed in 285us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212026.095531:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788212026.095743:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788212026.095869:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788212026.095890:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788212026.098674:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788212026.098692:0:20390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788212026.098702:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788212026.098704:0:20390:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788212026.098713:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788212026.098726:0:20390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8abec675cd28) 00000020:00000080:2.0:1788212026.098753:0:20390:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788212026.098758:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788212026.098821:0:20390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfe472e000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788212026.098830:0:20390:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788212026.098853:0:20390:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2afbce82f55a6ec2 00010000:00010000:3.0:1788212026.112645:0:20390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788212026.113026:0:20390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:3.0:1788212026.114952:0:20390:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788212026.124619:0:20390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788212026.124640:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.124646:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.124648:0:20390:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788212026.124652:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788212026.124656:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.124657:0:20390:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788212026.124659:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788212026.124661:0:20390:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788212026.124663:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.124665:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.124666:0:20390:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788212026.124668:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788212026.124670:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.124671:0:20390:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788212026.124674:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788212026.124723:0:20390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.124726:0:20390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.124727:0:20390:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788212026.124730:0:20390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788212026.124841:0:20389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788212026.124873:0:20389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788212026.124892:0:20389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6eb4 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.124904:0:20389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb81c00/0x2afbce82f55a6ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6eb4 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788212026.124913:0:20389:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfe472e000 from 1 10000000:01000000:1.0:1788212026.124922:0:20389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788212026.125096:0:20389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.125105:0:20389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.125118:0:20389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212026.125151:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788212026.125327:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.125416:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.126618:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905600 00000100:00100000:0.0:1788212026.126694:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905600 00000100:00100000:0.0:1788212026.126810:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788212026.126821:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:20389:x1875075660905600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788212026.126841:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212026.126861:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6ec9 expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.126897:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 18 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.126910:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 18 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.126921:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030400, rc 0) 00000100:00100000:0.0:1788212026.127133:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905600:12345-0@lo:101:mount.lustre.0 Request processed in 313us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.127140:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788212026.127239:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788212026.127257:0:20389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.127266:0:20389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788212026.127793:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788212026.128354:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788212026.128617:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788212026.128660:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788212026.128708:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788212026.128743:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788212026.128774:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788212026.128822:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788212026.128855:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788212026.128883:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788212026.129082:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788212026.129096:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788212026.129208:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788212026.129285:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.129546:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788212026.132672:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905728 00000100:00100000:2.0:1788212026.132690:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905728 00000100:00100000:2.0:1788212026.133441:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788212026.133455:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788212026.133920:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905728:12345-0@lo:501:mount.lustre.0 Request processed in 467us (4632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212026.133930:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788212026.134723:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788212026.134774:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788212026.134826:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.134857:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.135401:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905856 00000100:00100000:3.0:1788212026.135408:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905856 00000100:00100000:3.0:1788212026.135446:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788212026.135454:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec114cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788212026.135777:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec114cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905856:12345-0@lo:503:mount.lustre.0 Request processed in 322us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212026.135783:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788212026.135784:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:1.0:1788212026.136408:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788212026.136483:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212026.136530:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.136563:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.136599:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660905984 00000100:00100000:3.0:1788212026.136604:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660905984 00000100:00100000:3.0:1788212026.136631:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788212026.136638:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec114f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788212026.136793:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec114f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660905984:12345-0@lo:502:mount.lustre.0 Request processed in 156us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212026.136801:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788212026.136939:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660905984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788212026.137190:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788212026.137254:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788212026.137307:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788212026.137360:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788212026.137392:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788212026.137436:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788212026.137468:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788212026.137495:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788212026.137517:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788212026.137552:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.137582:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.139277:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906112 00000100:00100000:3.0:1788212026.139294:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906112 00000100:00100000:3.0:1788212026.139359:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788212026.139369:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660906112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788212026.139694:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660906112:12345-0@lo:502:mount.lustre.0 Request processed in 325us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212026.139703:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788212026.139927:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788212026.141284:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788212026.141311:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788212026.143561:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788212026.143576:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.143578:0:20394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788212026.143585:0:20394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfe472e000 00000020:00000080:1.0:1788212026.143588:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788212026.143594:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.143597:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.143598:0:20394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788212026.143601:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788212026.143602:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.143604:0:20394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788212026.143607:0:20394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8abfe472e000 00000020:00000080:1.0:1788212026.143609:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788212026.144221:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.144228:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.144230:0:20394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788212026.144233:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788212026.144236:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.144238:0:20394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788212026.144242:0:20394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8abfe472e000 00000020:00000080:1.0:1788212026.144244:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788212026.149154:0:20394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788212026.150134:0:20394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788212026.150138:0:20394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788212026.150145:0:20394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788212026.152496:0:20389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788212026.152542:0:20389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788212026.152565:0:20389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.152578:0:20389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788212026.152635:0:20389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788212026.152638:0:20389:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8abfe472e000 10000000:01000000:0.0:1788212026.152642:0:20389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8abfe472e000 10000000:01000000:0.0:1788212026.152647:0:20389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788212026.152652:0:20389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8abfe472e000 from 1 10000000:01000000:0.0:1788212026.152661:0:20389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788212026.152702:0:20389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.152711:0:20389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.152724:0:20389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212026.152754:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788212026.152831:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.152869:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc6181000 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.155142:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906240 00000100:00100000:3.0:1788212026.155154:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906240 00000100:00100000:3.0:1788212026.155232:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788212026.155243:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660906240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788212026.155259:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212026.155277:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a6ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6ed7 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.155306:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a6ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6ed7 expref: 19 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.155316:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec6063e00/0x2afbce82f55a6ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6ed7 expref: 19 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.155325:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec6063e00, rc 0) 00000100:00100000:3.0:1788212026.155403:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906240:12345-0@lo:101:mount.lustre.0 Request processed in 162us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212026.155410:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788212026.155557:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788212026.155574:0:20389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ede expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212026.155583:0:20389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6ede expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788212026.156332:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788212026.156822:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788212026.157098:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788212026.157143:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788212026.165482:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788212026.165642:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788212026.165679:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788212026.165722:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788212026.166066:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788212026.166100:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788212026.166186:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788212026.166237:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788212026.166272:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788212026.166452:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788212026.166492:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788212026.166522:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788212026.166567:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788212026.166604:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788212026.166638:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788212026.166688:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788212026.166724:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788212026.167505:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788212026.167572:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788212026.167611:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788212026.167646:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788212026.167698:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788212026.168449:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788212026.168515:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788212026.168572:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788212026.168609:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788212026.168642:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788212026.168689:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788212026.168725:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788212026.168908:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788212026.168946:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788212026.168997:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788212026.169036:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788212026.169091:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788212026.169127:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788212026.169159:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788212026.169858:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788212026.169902:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788212026.170028:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788212026.170043:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788212026.170153:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788212026.170264:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.170315:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc6181000 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.170782:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906368 00000100:00100000:3.0:1788212026.170790:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906368 00000100:00100000:3.0:1788212026.171820:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788212026.172143:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788212026.176429:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906368:12345-0@lo:501:mount.lustre.0 Request processed in 4287us (6153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.176445:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788212026.179359:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788212026.179464:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788212026.179551:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.179601:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffde3d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788212026.180797:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906496 00000100:00100000:1.0:1788212026.180811:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906496 00000100:00100000:1.0:1788212026.180896:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788212026.180905:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788212026.181432:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906496:12345-0@lo:503:mount.lustre.0 Request processed in 526us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212026.181441:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788212026.181444:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788212026.182634:0:20389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788212026.183804:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212026.183890:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.183937:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffde3d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.183973:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906624 00000100:00100000:0.0:1788212026.183981:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906624 00000100:00100000:0.0:1788212026.184028:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788212026.184036:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212026.188468:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906624:12345-0@lo:502:mount.lustre.0 Request processed in 4416us (4562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.188488:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788212026.188647:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788212026.191505:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788212026.200997:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788212026.201070:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788212026.201201:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788212026.201255:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788212026.201315:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788212026.201352:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788212026.201388:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788212026.201439:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788212026.201472:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788212026.201506:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788212026.201552:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788212026.201617:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788212026.201653:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788212026.201706:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788212026.202519:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788212026.202576:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788212026.202637:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788212026.202678:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788212026.202716:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788212026.202886:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788212026.202924:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788212026.202957:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788212026.203006:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788212026.203044:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788212026.203078:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788212026.203126:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788212026.203161:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788212026.203421:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788212026.203472:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788212026.203504:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788212026.203534:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788212026.203564:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788212026.203606:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788212026.203641:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788212026.203692:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788212026.203915:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788212026.203958:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788212026.204011:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788212026.204048:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788212026.204104:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212026.204365:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.204484:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffde3d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788212026.205709:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906752 00000100:00100000:3.0:1788212026.205724:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906752 00000100:00100000:0.0:1788212026.205943:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788212026.205958:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788212026.206459:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660906752:12345-0@lo:502:mount.lustre.0 Request processed in 503us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.206468:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788212026.208284:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660906752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788212026.208494:0:20389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788212026.208517:0:20389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788212026.216148:0:20399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788212026.216694:0:20399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8abfd2a1cd28) 00000020:00000080:0.0:1788212026.216812:0:20399:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788212026.216965:0:20399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8abfe472e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788212026.216971:0:20399:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8abfe472e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788212026.216974:0:20399:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8abfe472e000 3 00010000:00080000:0.0:1788212026.217016:0:20399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8abec7ce7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1788212026.221340:0:20399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788212026.223359:0:20399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788212026.223430:0:20399:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788212026.223451:0:20399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2afbce82f55a6eec 00000100:00080000:0.0:1788212026.223468:0:20399:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788212026.223477:0:20399:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8abec7ce7000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788212026.223531:0:20399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abffde64a80 x1875075660906880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788212026.223559:0:20399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788212026.223650:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788212026.223655:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788212026.223658:0:38:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788212026.223740:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1788212026.223744:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788212026.223750:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1788212026.223770:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abffde65f80 x1875075660907136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788212026.224002:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660906880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788212026.224114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.224162:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660907136:0@lo:8:kworker.0 00000100:00100000:0.0:1788212026.224163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660907008:0@lo:400:kworker.0 00000100:00100000:3.0:1788212026.224204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.224259:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907136 00000100:00100000:3.0:1788212026.224268:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907136 00000100:00100000:0.0:1788212026.224282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.224304:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788212026.224310:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660907264:0@lo:400:kworker.0 00000100:00100000:0.0:1788212026.224333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212026.224355:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788212026.224363:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660907392:0@lo:400:kworker.0 00000100:00100000:0.0:1788212026.224386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212026.224813:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907008 00000100:00100000:3.0:1788212026.224818:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907008 00000100:00100000:1.0:1788212026.224848:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788212026.224855:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875075660907136:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788212026.224945:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875075660907136:12345-0@lo:8:kworker.0 Request processed in 87us (738us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788212026.225104:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660906880 00000100:00100000:2.0:1788212026.225109:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660906880 00000100:00100000:2.0:1788212026.225125:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907264 00000100:00100000:2.0:1788212026.225127:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907264 00000100:00100000:2.0:1788212026.225142:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907392 00000100:00100000:2.0:1788212026.225145:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907392 00000100:00100000:0.0:1788212026.225186:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788212026.225187:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788212026.225195:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660907008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212026.225195:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660907264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212026.225253:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660907008:12345-0@lo:400:kworker.0 Request processed in 60us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212026.225260:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788212026.225336:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660907264:12345-0@lo:400:kworker.0 Request processed in 142us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.225343:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788212026.225359:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788212026.225364:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875075660906880:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788212026.225383:0:18981:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:0.0:1788212026.225431:0:18981:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2afbce82f55a6ef3 00000004:00100000:0.0:1788212026.225459:0:18981:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788212026.225498:0:18981:0:(import.c:65:import_set_state_nolock()) ffff8abfcd474800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788212026.225532:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875075660906880:12345-0@lo:38:llog_process_th.0 Request processed in 167us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212026.225539:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788212026.225562:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788212026.225598:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffde67800 x1875075660907264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212026.225614:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660907264:0@lo:400:kworker.0 00000100:00100000:0.0:1788212026.225626:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660907008:0@lo:400:kworker.0 00000100:00100000:1.0:1788212026.226333:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788212026.226554:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788212026.226563:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660907392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212026.226568:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788212026.226575:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788212026.226580:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788212026.226584:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660907136:0@lo:8:kworker.0 00010000:00080000:3.0:1788212026.226605:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffde64a80 x1875075660906880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788212036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788212026.226614:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788212026.226619:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875075660907392:12345-0@lo:400:kworker.0 Request processed in 59us (2232us total) trans 0 rc 0/0 00000100:00080000:3.0:1788212026.226620:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788212026.226626:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788212026.226631:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788212026.226633:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec7ce7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788212026.226638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875075660906880:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788212026.226746:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212026.226804:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788212026.226914:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8abffde65500 x1875075660907392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788212026.227095:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875075660907392:0@lo:400:kworker.0 00000040:00080000:1.0:1788212026.227625:0:20399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1788212026.228126:0:20389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788212026.228158:0:20389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788212026.228293:0:20389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ede expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.228307:0:20389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfc0030600/0x2afbce82f55a6ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6ede expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788212026.228360:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788212026.228362:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788212026.228363:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788212026.228365:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788212026.228366:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788212026.228367:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788212026.228369:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788212026.228372:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788212026.228374:0:20389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788212026.228378:0:20389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788212026.228381:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788212026.228383:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788212026.228383:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788212026.228384:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788212026.228385:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788212026.228386:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788212026.228388:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788212026.228389:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788212026.228390:0:20389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788212026.228421:0:20389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788212026.228447:0:20389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660907520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788212026.228532:0:20389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212026.228640:0:20389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc7ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788212026.228902:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907520 00000100:00100000:0.0:1788212026.228912:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907520 00000100:00100000:0.0:1788212026.229226:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788212026.229239:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:20389:x1875075660907520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788212026.229280:0:18971:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788212026.229298:0:18971:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788212026.273359:0:18971:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788212026.273410:0:18971:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788212026.278978:0:18995:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788212026.278995:0:18995:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788212026.279029:0:18995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.279050:0:18995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 19 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.279075:0:18995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.279128:0:18995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 19 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212026.279143:0:18995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 19 pid: 18971 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212026.279159:0:18995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660907648:0@lo:104: 00000100:00100000:2.0:1788212026.279262:0:18995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212026.279308:0:18995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abffbc7ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788212026.279491:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907648 00000100:00100000:1.0:1788212026.279504:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907648 00000100:00100000:1.0:1788212026.279578:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212026.279588:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660907648:12345-0@lo:104: 00010000:00010000:1.0:1788212026.279604:0:18963:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279687:0:18963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788212026.279694:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:18995:x1875075660907648:12345-0@lo:104: Request processed in 107us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212026.279702:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788212026.279727:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212026.279733:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279743:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06200 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:1.0:1788212026.279747:0:18968:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279771:0:18968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788212026.279779:0:18968:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788212026.279786:0:18968:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788212026.279823:0:18968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279830:0:18968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788212026.279855:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279864:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06200/0x2afbce82f55a6db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6db8 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.279885:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212026.279886:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212026.279888:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212026.279910:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660907776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788212026.279942:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212026.280241:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907776 00000100:00100000:1.0:1788212026.280248:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907776 00010000:00010000:1.0:1788212026.280271:0:18965:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 20 pid: 18971 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212026.280297:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212026.280305:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+20:3311:x1875075660907776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788212026.280326:0:18965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788212026.280334:0:18965:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 20 pid: 18971 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280345:0:18965:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 20 pid: 18971 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280367:0:18965:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280377:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788212026.280393:0:18965:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002421669s 00010000:00010000:1.0:1788212026.280399:0:18965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280407:0:18965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280416:0:18965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280423:0:18965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280429:0:18965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212026.280433:0:18965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280443:0:18965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280461:0:18965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212026.280473:0:18965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788212026.280506:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+20:3311:x1875075660907776:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212026.280513:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212026.280572:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9c126b8-6169-4174-8e0e-db6a3254d2db:3311:1875075660907776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788212026.281139:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030c00/0x2afbce82f55a6db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6db1 expref: 19 pid: 18971 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212026.281162:0:18995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18995:1875075660907648:0@lo:104: 00010000:00010000:3.0:1788212026.281204:0:18995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.281223:0:18995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.281230:0:18995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212026.281236:0:18995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abffdb80000/0x2afbce82f55a6efa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212026.291266:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:20389:x1875075660907520:12345-0@lo:253:mount.lustre.0 Request processed in 61925us (62627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212026.291284:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788212026.291422:0:20389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9c126b8-6169-4174-8e0e-db6a3254d2db:20389:1875075660907520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788212026.291447:0:20389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788212026.291452:0:20389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788212026.291455:0:20389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788212026.291456:0:20389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788212026.291457:0:20389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788212026.291459:0:20389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788212026.291460:0:20389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788212026.291462:0:20389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788212026.291465:0:20389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788212026.291487:0:20389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788212026.291508:0:20389:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788212026.300880:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212026.301150:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788212026.301440:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212026.301587:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788212026.301884:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788212026.302330:0:20389:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788212026.303227:0:20389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788212026.375142:0:20389:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788212026.375150:0:20389:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788212026.375252:0:20389:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788212026.375349:0:20389:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788212026.375366:0:20389:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788212026.375411:0:20389:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788212027.046609:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212028.070882:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788212028.143014:0:18976:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788212028.143022:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8abfd0b3f800 from 11 10000000:01000000:3.0:1788212028.143028:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788212028.143075:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212028.143087:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212028.143098:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212028.143125:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660907904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788212028.143236:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212028.143284:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc8b46600 going to sleep for 11 seconds 00000100:00100000:1.0:1788212028.144280:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660907904 00000100:00100000:1.0:1788212028.144292:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660907904 00000100:00100000:1.0:1788212028.144354:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788212028.144364:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660907904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788212028.144380:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212028.144401:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a6f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a6f01 expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212028.144428:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a6f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a6f01 expref: 19 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212028.144465:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07800/0x2afbce82f55a6f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6f01 expref: 19 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212028.144475:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07800, rc 0) 00000100:00100000:1.0:1788212028.144728:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660907904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 365us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212028.144736:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788212028.146989:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660907904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212028.147020:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6f08 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212028.147032:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a6f08 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212028.147137:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660908032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788212028.147240:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212028.147291:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc776eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788212028.149454:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908032 00000100:00100000:1.0:1788212028.149469:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908032 00000100:00100000:1.0:1788212028.149546:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788212028.149557:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660908032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788212028.149584:0:18971:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788212028.149619:0:18971:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788212028.149623:0:18971:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788212028.149751:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660908032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212028.149759:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788212028.150959:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660908032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788212028.151072:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788212028.151087:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6f08 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212028.151101:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec6063a00/0x2afbce82f55a6f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a6f08 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212029.095004:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788212029.157504:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788212029.157615:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660908160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788212029.157722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212029.157969:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908160 00000100:00100000:1.0:1788212029.157980:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908160 00000100:00100000:1.0:1788212029.158097:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788212029.158109:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660908160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788212029.158152:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788212029.158257:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660908160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212029.158266:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788212029.158388:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660908160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788212029.158493:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788212030.117492:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.146525:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788212031.720406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788212031.720416:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788212031.720422:0:38:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788212031.720442:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8abec587e800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1788212031.720469:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8abfef9aa300 x1875075660908544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788212031.720553:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660908288:0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.720656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212031.720725:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660908928:0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.720755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212031.720789:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788212031.720794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660908800:0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.720817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212031.720852:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660908544:0@lo:8:kworker.0 00000100:00100000:3.0:1788212031.720883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212031.720924:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908928 00000100:00100000:3.0:1788212031.720934:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908928 00000100:00100000:3.0:1788212031.721029:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908800 00000100:00100000:3.0:1788212031.721033:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908800 00000100:00100000:0.0:1788212031.721613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660908672:0@lo:400:kworker.0 00000100:00100000:0.0:1788212031.721661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212031.721680:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788212031.721688:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660908416:0@lo:400:kworker.0 00000100:00100000:0.0:1788212031.721710:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212031.721772:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908288 00000100:00100000:0.0:1788212031.721784:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908288 00000100:00100000:0.0:1788212031.721829:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788212031.721840:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3309:x1875075660908288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212031.721906:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3309:x1875075660908288:12345-0@lo:400:kworker.0 Request processed in 68us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212031.721914:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788212031.723361:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908672 00000100:00100000:3.0:1788212031.723374:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908672 00000100:00100000:3.0:1788212031.723474:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788212031.723488:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660908928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.723578:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875075660908928:12345-0@lo:400:kworker.0 Request processed in 94us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.723585:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788212031.723603:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788212031.723612:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660908800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.723647:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875075660908800:12345-0@lo:400:kworker.0 Request processed in 37us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.723653:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788212031.723663:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788212031.723670:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660908672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.723709:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875075660908672:12345-0@lo:400:kworker.0 Request processed in 39us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.723713:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788212031.723747:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908544 00000100:00100000:3.0:1788212031.723751:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908544 00000100:00100000:3.0:1788212031.723772:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660908416 00000100:00100000:3.0:1788212031.723776:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660908416 00000100:00100000:3.0:1788212031.723806:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788212031.723814:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212031.723850:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660908416:12345-0@lo:400:kworker.0 Request processed in 39us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.723868:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788212031.723878:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788212031.723883:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875075660908544:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788212031.723911:0:19668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:3.0:1788212031.723946:0:19668:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2afbce82f55a6f0f 00002000:00100000:3.0:1788212031.723966:0:19668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8abec527f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788212031.723970:0:19668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788212031.723974:0:19668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788212031.724465:0:19668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788212031.724496:0:19668:0:(import.c:65:import_set_state_nolock()) ffff8abec527c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788212031.724556:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875075660908544:12345-0@lo:8:kworker.0 Request processed in 670us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.724566:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788212031.724592:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788212031.724598:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788212031.725241:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660908416:0@lo:400:kworker.0 00010000:00080000:0.0:1788212031.725262:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9a9c00 x1875075660908672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212031.725274:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875075660908672:0@lo:400:kworker.0 00010000:00080000:1.0:1788212031.726345:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9aa300 x1875075660908544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788212056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788212031.726371:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788212031.726384:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788212031.726392:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788212031.726396:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8abec587e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788212031.726416:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788212031.726424:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875075660908544:0@lo:8:kworker.0 00000004:00080000:1.0:1788212031.726456:0:19003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788212031.727041:0:19003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 621032872679ns, next at 0ns, rc = 0 00010000:00080000:1.0:1788212031.727131:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9aaa00 x1875075660908800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212031.727144:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875075660908800:0@lo:400:kworker.0 00000100:00100000:1.0:1788212031.727159:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660908288:0@lo:400:kworker.0 00010000:00080000:1.0:1788212031.727210:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9a9180 x1875075660908928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788212031.727219:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875075660908928:0@lo:400:kworker.0 00000004:00080000:2.0:1788212031.729072:0:19004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788212031.729119:0:19004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19004:1875075660909184:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788212031.729521:0:19004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212031.729568:0:19004:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfd85159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788212031.729600:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909184 00000100:00100000:2.0:1788212031.729608:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909184 00000100:00100000:2.0:1788212031.729790:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788212031.729801:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:19004:x1875075660909184:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788212031.730946:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788212031.731318:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788212031.731401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212031.731513:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909056 00000100:00100000:1.0:1788212031.731524:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909056 00000100:00100000:1.0:1788212031.731591:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788212031.731601:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660909056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788212031.731636:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788212031.731702:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660909056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212031.731721:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788212031.732219:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac001202a00 x1875075660909056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788212047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788212031.732239:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909056:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788212031.742148:0:19668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788212031.742210:0:19668:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1788212031.742216:0:19668:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:65) 00002000:00010000:3.0:1788212031.766074:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.766089:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.766119:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.766125:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.766132:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.766152:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.766666:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.766676:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.773961:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.773991:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.774003:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.774473:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.774481:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.774494:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.774517:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.774646:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.775144:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.775154:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.775156:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.779642:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.781141:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781162:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.781180:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.781187:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781203:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781215:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781223:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781248:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.781265:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.781271:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781278:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.781283:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781303:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781320:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781327:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.781347:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.781349:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.781351:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.786773:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.786789:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786805:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.786810:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.786816:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786829:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786839:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786854:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786873:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.786886:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.786891:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786898:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.786902:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786911:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786927:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786934:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.786954:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.786956:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.786957:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.790818:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.790843:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.790859:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.790865:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.790871:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.790886:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.790896:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.790905:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.790936:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788212031.791059:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212031.791067:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.791155:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212031.791161:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.791189:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.791353:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.791363:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6f2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.791389:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.791393:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.791396:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.795975:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.795995:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796020:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.796025:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.796033:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796049:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796071:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796079:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796101:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.796125:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.796130:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796138:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.796142:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796151:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796190:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796198:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.796219:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.796226:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.796228:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.802640:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.803784:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.803808:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.803813:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.803819:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.803834:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.803845:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.803853:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.803877:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788212031.803914:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212031.803924:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.803935:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212031.803941:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.804034:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.804055:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.804063:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6f39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.804186:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.804256:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.804260:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.804544:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.804550:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804559:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.804562:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.804566:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804581:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804589:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804596:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804613:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.804624:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.804628:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804635:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.804639:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804646:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804670:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804677:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.804696:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.804699:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.804701:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.805116:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.805123:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.805132:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.805135:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.805140:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.805149:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.805157:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.805164:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.805203:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788212031.806222:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212031.806234:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.806245:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212031.806250:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.806261:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.806279:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.806307:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.806334:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.806337:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.806339:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.815003:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.815017:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815265:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.815271:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.815279:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815295:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815307:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815316:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815345:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.815364:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.815370:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815379:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.815384:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815394:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815423:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815430:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6f4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.815451:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.815453:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.815455:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.821810:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.821826:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.821844:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.821849:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.821855:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.821869:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.821880:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.821889:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.821930:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788212031.821965:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212031.821976:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.821987:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212031.821994:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.822005:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.822030:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.822039:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c01421c/0x2afbce82f55a6f55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.822061:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.822063:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.822065:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.824117:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.824131:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824149:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.824153:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.824159:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824203:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824214:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824223:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824239:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.824252:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.824258:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824267:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.824279:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824289:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824306:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824313:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f4c25c3/0x2afbce82f55a6f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824332:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.824334:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.824335:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.824858:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.824866:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824876:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.824880:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.824885:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824893:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824901:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824916:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.824939:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788212031.825056:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788212031.825064:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.825213:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212031.825219:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.825230:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.825246:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.825254:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8288b49/0x2afbce82f55a6f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.825274:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.825276:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.825278:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.825381:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.825387:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825395:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.825398:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.825403:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825412:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825420:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825426:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825440:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.825448:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.825451:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825464:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.825468:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825476:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825487:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825494:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c07af2de/0x2afbce82f55a6f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825509:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.825510:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.825512:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.825916:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.825922:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825930:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.825933:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.825937:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825946:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825959:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825966:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.825986:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212031.826419:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.826425:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826435:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.826439:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.826442:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826450:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826457:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826464:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826488:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788212031.826499:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788212031.826503:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826509:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.826514:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.826519:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.826526:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826541:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826548:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c182cc2f/0x2afbce82f55a6f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.826562:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.826564:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.826566:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.829675:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.829688:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829706:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.829718:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.829725:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829739:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829749:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829756:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829776:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.829792:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.829799:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829808:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.829813:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829821:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829837:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829858:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e040d25/0x2afbce82f55a6f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.829881:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.829883:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.829885:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.830435:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.830441:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830450:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.830454:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.830458:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830466:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830475:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830482:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830498:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.830506:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.830517:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830524:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.830528:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830535:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830547:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830553:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004babf9fe/0x2afbce82f55a6f86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.830567:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.830568:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.830570:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.831040:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.831047:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831057:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.831060:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.831064:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831083:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831091:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831098:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831124:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.831133:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.831136:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831143:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.831146:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831154:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831184:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831192:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445b87cc/0x2afbce82f55a6f8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831211:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.831213:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.831215:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.831690:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.831697:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831707:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.831711:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.831716:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831725:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831734:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.831742:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833738:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788212031.833763:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788212031.833770:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833797:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:3.0:1788212031.833803:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833811:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833831:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833838:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a5ec07/0x2afbce82f55a6f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.833857:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.833858:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.833860:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834736:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834746:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.834757:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.834761:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.834768:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.834793:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.834799:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa21dff9/0x2afbce82f55a6f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.834814:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834815:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834817:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834822:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.834823:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.834857:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.834865:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.834877:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.834881:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.834888:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.834900:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.834917:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.834925:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.834953:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788212031.835652:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.835658:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.835667:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.835672:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.835681:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.835695:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.835703:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d476080c/0x2afbce82f55a6f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.835732:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.835733:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.835735:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.835794:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.835801:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.835810:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.835814:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.835820:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.835829:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.835838:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.835845:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.835906:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212031.836479:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.836486:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.836496:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.836500:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.836505:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.836515:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.836727:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.836735:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788212031.837479:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788212031.837866:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212031.837878:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837890:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.837895:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837904:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837928:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837935:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1eb43b3/0x2afbce82f55a6fa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837957:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.837960:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837966:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6063200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.837981:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837989:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.837999:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.838008:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.838010:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.838011:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.838189:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.838197:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76a203f/0x2afbce82f55a6fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.839034:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.839337:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.839360:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.839365:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.839374:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.839387:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.839398:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.839407:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.839485:0:20634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.839494:0:20634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.839504:0:20634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec6062800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.839509:0:20634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.839518:0:20634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.839544:0:20634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.839553:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.839562:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.839564:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.839689:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.839695:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5bb7c37/0x2afbce82f55a6fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.840211:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.840218:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.840228:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.840232:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.840237:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.840259:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.840268:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.840275:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.840700:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.840708:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.840717:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c1200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.840721:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.840730:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.840743:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212031.840808:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.840812:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212031.840815:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.841930:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.841940:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c488f893/0x2afbce82f55a6fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.842704:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.842713:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.842727:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.842732:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.842738:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.842751:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.842772:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.842781:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.842888:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.842896:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.842903:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.842908:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.842916:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.842932:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.842949:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.842951:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.842953:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.843018:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.843024:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001528133f/0x2afbce82f55a6fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.843749:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.843757:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.843767:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.843771:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.843776:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.843787:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.843796:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.843817:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.844925:0:20634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.844936:0:20634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.844947:0:20634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c1400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.844953:0:20634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.844964:0:20634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.844985:0:20634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.845132:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.845140:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af0c7da4/0x2afbce82f55a6fc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.845921:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.845928:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.845942:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.845947:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.845954:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.845967:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.845977:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.845986:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.846160:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.846208:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.846211:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.846213:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.846246:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.846255:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c1a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212031.846260:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.846268:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.846285:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.846293:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.846295:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.846297:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.846383:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.846389:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa6600a/0x2afbce82f55a6fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788212031.846983:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.846990:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.847000:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.847004:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.847011:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.847022:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.847031:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.855163:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.856010:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.856020:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.856030:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.856035:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.856061:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.856083:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.856126:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.856128:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.856130:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.859657:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788212031.859679:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a75a928/0x2afbce82f55a6fd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.860186:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.864872:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.864891:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.864912:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.864917:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.864925:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.864941:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.864953:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.864961:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.864997:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788212031.865530:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.865536:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.865546:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.865549:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.865560:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.865570:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.865578:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.865584:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.865602:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788212031.866034:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.866040:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.866050:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.866053:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.866057:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.866066:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.866074:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.866092:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.866127:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788212031.867014:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788212031.867027:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867049:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.867055:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867065:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867085:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867091:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2fbf3d1/0x2afbce82f55a6fda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867140:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212031.867143:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867150:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac0020c0c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.867153:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867161:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867191:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867198:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008321b094/0x2afbce82f55a6fe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867209:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212031.867213:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867218:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db0a00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212031.867222:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867240:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867252:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867259:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962973dc/0x2afbce82f55a6fe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212031.867281:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.867283:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212031.867286:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.870369:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.871303:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788212031.872399:0:19668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788212031.872415:0:19668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.872437:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=621s v=(0 0) 00010000:00010000:3.0:1788212031.872442:0:19668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212031.872449:0:19668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.872463:0:19668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.872474:0:19668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.872482:0:19668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212031.872515:0:19668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788212031.873243:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788212031.873252:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.873261:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db0e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212031.873265:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.873291:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.873311:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212031.873321:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.873323:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212031.873325:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212031.873370:0:19668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193bf0eb/0x2afbce82f55a6fef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788212031.875679:0:19668:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788212031.875783:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:19004:x1875075660909184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 145980us (146259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212031.875794:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788212031.877274:0:19004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19004:1875075660909184:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788212031.877292:0:19004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788212031.877342:0:19004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19004:1875075660909312:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788212031.877388:0:19004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212031.877434:0:19004:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfef2e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788212031.878230:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909312 00000100:00100000:3.0:1788212031.878244:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909312 00000100:00100000:3.0:1788212031.878304:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788212031.878313:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19004:x1875075660909312:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788212031.878357:0:20100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788212031.894955:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:19004:x1875075660909312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16630us (17555us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788212031.894970:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788212031.895034:0:19004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001200e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19004:1875075660909312:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788212031.895063:0:19004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:3.0:1788212032.168150:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212033.190362:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788212034.216315:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212034.287926:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788212034.287952:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788212034.288028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212034.288129:0:19670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909440 00000100:00100000:1.0:1788212034.288158:0:19670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909440 00000100:00100000:1.0:1788212034.288601:0:19670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788212034.288613:0:19670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660909440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788212034.288651:0:19670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788212034.288842:0:19670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660909440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212034.288850:0:19670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788212034.288942:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788212034.288985:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909440:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788212034.497049:0:20746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788212035.238256:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788212035.754617:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788212036.262661:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212036.850264:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660909568:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850436:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660910080:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850492:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788212036.850498:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660909696:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850541:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660910208:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850587:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909824:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850639:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788212036.850645:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660909952:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.850721:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909568 00000100:00100000:3.0:1788212036.850728:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909568 00000100:00100000:3.0:1788212036.850773:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788212036.850782:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660909568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850828:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660909568:12345-0@lo:400:kworker.0 Request processed in 47us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.850836:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788212036.850871:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910080 00000100:00100000:3.0:1788212036.850874:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910080 00000100:00100000:3.0:1788212036.850904:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910208 00000100:00100000:3.0:1788212036.850908:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910208 00000100:00100000:3.0:1788212036.850923:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909952 00000100:00100000:3.0:1788212036.850925:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909952 00000100:00100000:3.0:1788212036.850940:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788212036.850947:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660910080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.850977:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660910080:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.850984:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788212036.850994:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788212036.851000:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660910208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851039:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660910208:12345-0@lo:400:kworker.0 Request processed in 38us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.851044:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788212036.851056:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788212036.851061:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851099:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660909952:12345-0@lo:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.851106:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788212036.851124:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909696 00000100:00100000:3.0:1788212036.851127:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909696 00000100:00100000:3.0:1788212036.851150:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660909824 00000100:00100000:3.0:1788212036.851153:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660909824 00000100:00100000:3.0:1788212036.851194:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788212036.851201:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660909696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851229:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660909696:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.851236:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788212036.851247:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788212036.851253:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660909824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851277:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660909824:12345-0@lo:400:kworker.0 Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.851282:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788212036.851327:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660909696:0@lo:400:kworker.0 00010000:00080000:3.0:1788212036.851341:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9a8000 x1875075660910208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788212036.851351:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660910208:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851360:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660909568:0@lo:400:kworker.0 00010000:00080000:3.0:1788212036.851368:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9a9c00 x1875075660910080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788212036.851377:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660910080:0@lo:400:kworker.0 00000100:00080000:3.0:1788212036.851410:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788212036.851414:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788212036.851417:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788212036.851433:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abfef9aa300 x1875075660909952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788212052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788212036.851442:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660909952:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851453:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef9aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660909824:0@lo:400:kworker.0 00000100:00100000:3.0:1788212036.851879:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660910336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788212036.851913:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212036.851953:0:19670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910336 00000100:00100000:3.0:1788212036.851957:0:19670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910336 00000100:00100000:3.0:1788212036.851983:0:19670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788212036.851989:0:19670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660910336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788212036.852033:0:19670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788212036.852068:0:19670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875075660910336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212036.852075:0:19670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788212036.852150:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660910336:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788212036.991111:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788212036.991362:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788212036.994514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212036.994621:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841792 00000100:00100000:1.0:1788212036.994635:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841792 00000100:00100000:1.0:1788212036.994714:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:1.0:1788212036.994722:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875075637841792:12345-192.168.204.29@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788212036.994751:0:18971:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 54d0ecf5-5943-42bf-82b5-6e0157b29789@192.168.204.29@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1788212036.994777:0:18971:0:(genops.c:1385:class_connect()) connect: client 54d0ecf5-5943-42bf-82b5-6e0157b29789, cookie 0x2afbce82f55a6ff6 00000100:00080000:1.0:1788212036.994924:0:18971:0:(import.c:65:import_set_state_nolock()) ffff8abfd854a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788212036.994998:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+5:2357:x1875075637841792:12345-192.168.204.29@tcp:250:mount.lustre.0 Request processed in 275us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212036.995015:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:1.0:1788212037.002031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.002093:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637841920 00000100:00100000:3.0:1788212037.002104:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637841920 00000100:00100000:3.0:1788212037.002220:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788212037.002234:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+5:16754:x1875075637841920:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788212037.002257:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212037.002302:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec7db0e00/0x2afbce82f55a6ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d67 expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.002343:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec7db0e00/0x2afbce82f55a6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d67 expref: 6 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.002359:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec7db0e00/0x2afbce82f55a6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d67 expref: 6 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.002372:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db0e00, rc 0) 00000100:00100000:3.0:1788212037.002472:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+6:16754:x1875075637841920:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 240us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.002480:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1788212037.006394:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.006622:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842048 00000100:00100000:1.0:1788212037.006638:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842048 00000100:00100000:1.0:1788212037.006724:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:1.0:1788212037.006738:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec6d69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+6:16754:x1875075637842048:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788212037.007156:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec6d69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+6:16754:x1875075637842048:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 418us (778us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788212037.007209:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:0.0:1788212037.009368:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.009473:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842176 00000100:00100000:3.0:1788212037.009486:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842176 00000100:00100000:3.0:1788212037.009593:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1788212037.009605:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcacc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+6:16754:x1875075637842176:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788212037.009626:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212037.009649:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec7db1e00/0x2afbce82f55a7004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d6e expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.009682:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec7db1e00/0x2afbce82f55a7004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d6e expref: 7 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.009694:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec7db1e00/0x2afbce82f55a7004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d6e expref: 7 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.009703:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db1e00, rc 0) 00000100:00100000:3.0:1788212037.009793:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcacc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+7:16754:x1875075637842176:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 191us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.009801:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1788212037.012607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.012751:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842304 00000100:00100000:0.0:1788212037.012764:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842304 00000100:00100000:0.0:1788212037.012976:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:0.0:1788212037.012991:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcacca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+7:16754:x1875075637842304:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788212037.013455:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcacca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16754:x1875075637842304:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 466us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.014541:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:0.0:1788212037.015978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.016085:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842432 00000100:00100000:3.0:1788212037.016095:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842432 00000100:00100000:3.0:1788212037.016143:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:3.0:1788212037.016152:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16754:x1875075637842432:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788212037.016644:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16754:x1875075637842432:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 491us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.016653:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1788212037.020416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.020894:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842560 00000100:00100000:0.0:1788212037.020904:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842560 00000100:00100000:0.0:1788212037.020967:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:0.0:1788212037.020993:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16772:x1875075637842560:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788212037.021324:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16772:x1875075637842560:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 331us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.021333:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:3.0:1788212037.049449:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.049516:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842688 00000100:00100000:0.0:1788212037.049528:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842688 00000100:00100000:0.0:1788212037.049603:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1788212037.049615:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16772:x1875075637842688:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788212037.050012:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16772:x1875075637842688:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 389us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.050021:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:3.0:1788212037.056299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.056440:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842816 00000100:00100000:0.0:1788212037.056451:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842816 00000100:00100000:0.0:1788212037.056699:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:0.0:1788212037.056712:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc6a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+8:16754:x1875075637842816:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788212037.056740:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212037.056765:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a700b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d98 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.056799:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a700b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d98 expref: 9 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.056812:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0030e00/0x2afbce82f55a700b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d98 expref: 9 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.056822:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0030e00, rc 0) 00000100:00100000:0.0:1788212037.056986:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc6a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+9:16754:x1875075637842816:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 276us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.056993:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:2.0:1788212037.059723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.059831:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637842944 00000100:00100000:1.0:1788212037.059842:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637842944 00000100:00100000:1.0:1788212037.059918:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:1.0:1788212037.059930:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+9:16754:x1875075637842944:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788212037.059961:0:18971:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788212037.059993:0:18971:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788212037.059998:0:18971:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788212037.060012:0:18971:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788212037.060014:0:18971:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788212037.064288:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+9:16754:x1875075637842944:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 4342us (4562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.064307:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:2.0:1788212037.072097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.073080:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843072 00000100:00100000:0.0:1788212037.073092:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843072 00000100:00100000:0.0:1788212037.073157:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:0.0:1788212037.073207:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfcc50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+9:16754:x1875075637843072:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788212037.073230:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212037.073251:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5d9f expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.073281:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 10 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.073292:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 10 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212037.073301:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc0031a00, rc 0) 00000100:00100000:0.0:1788212037.073381:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfcc50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16754:x1875075637843072:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 215us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.073388:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:2.0:1788212037.077581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.080391:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843200 00000100:00100000:1.0:1788212037.080411:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843200 00000100:00100000:1.0:1788212037.080564:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1788212037.080578:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16754:x1875075637843200:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788212037.080905:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16754:x1875075637843200:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 329us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212037.080913:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:2.0:1788212037.083710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.084016:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843328 00000100:00100000:3.0:1788212037.084028:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843328 00000100:00100000:3.0:1788212037.084142:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:3.0:1788212037.084152:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16754:x1875075637843328:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788212037.084508:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16754:x1875075637843328:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 356us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.084517:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:2.0:1788212037.088449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.089130:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843456 00000100:00100000:1.0:1788212037.089143:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843456 00000100:00100000:1.0:1788212037.089240:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:1.0:1788212037.089251:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec5208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16778:x1875075637843456:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788212037.090359:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec5208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16778:x1875075637843456:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 1099us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212037.090402:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:2.0:1788212037.100726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.104708:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843584 00000100:00100000:3.0:1788212037.104726:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843584 00000100:00100000:3.0:1788212037.104796:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:3.0:1788212037.104807:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16778:x1875075637843584:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788212037.105158:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16778:x1875075637843584:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 352us (4442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.105208:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:2.0:1788212037.116915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.117214:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843712 00000100:00100000:3.0:1788212037.117224:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843712 00000100:00100000:3.0:1788212037.117279:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788212037.117288:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875075637843712:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788212037.117315:0:18979:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ac19d59b-b018-4eda-9f21-935367606cee@192.168.204.29@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:3.0:1788212037.117367:0:18979:0:(genops.c:1385:class_connect()) connect: client ac19d59b-b018-4eda-9f21-935367606cee, cookie 0x2afbce82f55a7019 00000004:00100000:3.0:1788212037.117400:0:18979:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788212037.117406:0:18979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788212037.219807:0:18979:0:(import.c:65:import_set_state_nolock()) ffff8abfd854d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788212037.220117:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:2357:x1875075637843712:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 102826us (103214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212037.220128:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1788212037.230005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.230102:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843968 00000100:00100000:3.0:1788212037.230112:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843968 00000100:00100000:3.0:1788212037.230219:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788212037.230230:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637843968:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788212037.230279:0:18980:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788212037.230398:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637843968:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.230407:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00080000:1.0:1788212037.230840:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212037.237435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212037.237487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.237619:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637843840 00000100:00100000:1.0:1788212037.237632:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637843840 00000100:00100000:1.0:1788212037.237809:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844096 00000100:00100000:1.0:1788212037.237824:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844096 00000100:00100000:0.0:1788212037.237927:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788212037.237943:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+7:0:x1875075637843840:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788212037.237983:0:18981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788212037.238107:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+7:0:x1875075637843840:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 167us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.238115:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788212037.238141:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1788212037.238147:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637844096:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788212037.238215:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637844096:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 67us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.238221:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788212037.245539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212037.245722:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844480 00000100:00100000:1.0:1788212037.245738:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844480 00000100:00100000:1.0:1788212037.245811:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788212037.246009:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637844480:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788212037.249728:0:18982:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3615us 00000100:00100000:2.0:1788212037.258732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212037.258781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212037.258905:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844224 00000100:00100000:0.0:1788212037.258917:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844224 00000100:00100000:0.0:1788212037.258962:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844352 00000100:00100000:0.0:1788212037.258965:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844352 00000100:00100000:0.0:1788212037.258990:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1788212037.259010:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875075637844224:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788212037.259049:0:19668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ac19d59b-b018-4eda-9f21-935367606cee@192.168.204.29@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:0.0:1788212037.259090:0:19668:0:(genops.c:1385:class_connect()) connect: client ac19d59b-b018-4eda-9f21-935367606cee, cookie 0x2afbce82f55a7020 00002000:00100000:0.0:1788212037.259105:0:19668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac19d59b-b018-4eda-9f21-935367606cee/ffff8abec7ce5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788212037.259130:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1788212037.259138:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637844352:12345-192.168.204.29@tcp:8:mount.lustre.0 00002000:00100000:0.0:1788212037.259143:0:19668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:3.0:1788212037.259199:0:19667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ac19d59b-b018-4eda-9f21-935367606cee@192.168.204.29@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:3.0:1788212037.259242:0:19667:0:(genops.c:1385:class_connect()) connect: client ac19d59b-b018-4eda-9f21-935367606cee, cookie 0x2afbce82f55a7027 00002000:00100000:3.0:1788212037.259250:0:19667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac19d59b-b018-4eda-9f21-935367606cee/ffff8abfc8634000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788212037.259257:0:19667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788212037.259638:0:19668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788212037.259674:0:19668:0:(import.c:65:import_set_state_nolock()) ffff8abec7ce6000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1788212037.259692:0:19667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788212037.259715:0:19667:0:(import.c:65:import_set_state_nolock()) ffff8abfc8637000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788212037.259742:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac19d59b-b018-4eda-9f21-935367606cee+6:2357:x1875075637844224:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 741us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.259750:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001201f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:2357:x1875075637844352:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 609us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212037.259756:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788212037.259765:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000004:00200000:3.0:1788212037.272395:0:18982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788212037.272862:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:16754:x1875075637844480:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 26858us (27332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.272875:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00010000:00010000:2.0:1788212037.291619:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788212037.585669:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212037.585822:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844608 00000100:00100000:3.0:1788212037.585848:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844608 00000100:00100000:3.0:1788212037.585919:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788212037.585930:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:16799:x1875075637844608:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:3.0:1788212037.585966:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212037.586027:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1a00/0x2afbce82f55a702e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5dc9 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.586095:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.586109:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.586123:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788212037.587455:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788212037.587466:0:18980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788212037.587735:0:18980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.587782:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1a00/0x2afbce82f55a702e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dc9 expref: 8 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.587802:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dc9 expref: 7 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212037.587812:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:3.0:1788212037.587815:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788212037.587818:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db0000, rc 0) 00000100:00100000:3.0:1788212037.588128:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+7:16799:x1875075637844608:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 2198us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212037.588138:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:3.0:1788212038.315254:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212039.333498:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212039.397395:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660910464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788212039.397472:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212039.397667:0:19670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910464 00000100:00100000:0.0:1788212039.397676:0:19670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910464 00000100:00100000:0.0:1788212039.397763:0:19670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788212039.397773:0:19670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660910464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788212039.397808:0:19670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1788212039.397880:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788212039.399232:0:19670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660910464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1442us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212039.399247:0:19670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788212039.399428:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660910464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788212039.918210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212039.918477:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844736 00000100:00100000:1.0:1788212039.918487:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844736 00000100:00100000:1.0:1788212039.918570:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1788212039.918583:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+7:16851:x1875075637844736:12345-192.168.204.29@tcp:41:lfs.0 00000004:00000024:1.0:1788212039.918637:0:18981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788212039.918729:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+7:16851:x1875075637844736:12345-192.168.204.29@tcp:41:lfs.0 Request processed in 148us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212039.918737:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00080000:2.0:1788212039.918820:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788212039.923302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212039.923449:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844864 00000100:00100000:2.0:1788212039.923459:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844864 00000100:00100000:2.0:1788212039.923533:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788212039.923544:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac19d59b-b018-4eda-9f21-935367606cee+6:16851:x1875075637844864:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:2.0:1788212039.923571:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788212039.923655:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac19d59b-b018-4eda-9f21-935367606cee+6:16851:x1875075637844864:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212039.923663:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00080000:1.0:1788212039.924130:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788212039.931410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212039.931523:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637844992 00000100:00100000:0.0:1788212039.931535:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637844992 00000100:00100000:0.0:1788212039.931624:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1788212039.931635:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac19d59b-b018-4eda-9f21-935367606cee+6:16851:x1875075637844992:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1788212039.931676:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788212039.931768:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac19d59b-b018-4eda-9f21-935367606cee+6:16851:x1875075637844992:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 134us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212039.931776:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00080000:1.0:1788212039.932069:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788212040.275209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.275590:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845120 00000100:00100000:1.0:1788212040.275613:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845120 00000100:00100000:1.0:1788212040.275671:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:1.0:1788212040.275682:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+10:16886:x1875075637845120:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788212040.275698:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212040.275715:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06400/0x2afbce82f55a703c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5dd0 expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.275756:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06400/0x2afbce82f55a703c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dd0 expref: 11 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.275768:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b06400/0x2afbce82f55a703c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dd0 expref: 11 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.275777:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06400, rc 0) 00000100:00100000:1.0:1788212040.276078:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845120:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 396us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212040.276087:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:0.0:1788212040.286144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.286322:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845248 00000100:00100000:3.0:1788212040.286332:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845248 00000100:00100000:3.0:1788212040.286394:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:3.0:1788212040.286405:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845248:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788212040.286772:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845248:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 368us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.286792:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:2.0:1788212040.294731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.294864:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845376 00000100:00100000:1.0:1788212040.294878:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845376 00000100:00100000:1.0:1788212040.294978:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:1.0:1788212040.294993:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845376:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788212040.295453:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845376:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 463us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212040.295463:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:2.0:1788212040.303473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212040.303645:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845504 00000100:00100000:0.0:1788212040.303655:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845504 00000100:00100000:0.0:1788212040.303719:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:0.0:1788212040.303731:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16891:x1875075637845504:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788212040.304310:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16891:x1875075637845504:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 577us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212040.304320:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:0.0:1788212040.322623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.323496:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845632 00000100:00100000:3.0:1788212040.323508:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845632 00000100:00100000:3.0:1788212040.323572:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:3.0:1788212040.323582:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16891:x1875075637845632:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788212040.323902:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16891:x1875075637845632:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 320us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.323910:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:2.0:1788212040.338796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.340024:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845760 00000100:00100000:1.0:1788212040.340037:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845760 00000100:00100000:1.0:1788212040.340120:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:1.0:1788212040.340133:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16886:x1875075637845760:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788212040.340195:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212040.340215:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07c00/0x2afbce82f55a7043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5dfa expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.340246:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07c00/0x2afbce82f55a7043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dfa expref: 12 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.340273:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07c00/0x2afbce82f55a7043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dfa expref: 12 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212040.340282:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07c00, rc 0) 00000100:00100000:1.0:1788212040.340366:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16886:x1875075637845760:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 228us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212040.340381:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:2.0:1788212040.344924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212040.345116:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637845888 00000100:00100000:0.0:1788212040.345130:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637845888 00000100:00100000:0.0:1788212040.345240:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:0.0:1788212040.345252:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16886:x1875075637845888:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788212040.345282:0:18973:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788212040.345303:0:18973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788212040.345308:0:18973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788212040.345311:0:18973:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788212040.345314:0:18973:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788212040.351349:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16886:x1875075637845888:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 6085us (6427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.351569:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:2.0:1788212040.358155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.358528:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846016 00000100:00100000:3.0:1788212040.358542:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846016 00000100:00100000:3.0:1788212040.358609:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:3.0:1788212040.358621:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16886:x1875075637846016:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788212040.358643:0:18974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212040.358664:0:18974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e01 expref: -99 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.358698:0:18974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 13 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.358710:0:18974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 13 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.358720:0:18974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db1a00, rc 0) 00000100:00100000:3.0:1788212040.358801:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16886:x1875075637846016:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 181us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.358809:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00010000:00010000:0.0:1788212040.359873:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788212040.365759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.365866:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846144 00000100:00100000:3.0:1788212040.365878:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846144 00000100:00100000:3.0:1788212040.365969:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1788212040.365981:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16886:x1875075637846144:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788212040.366767:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16886:x1875075637846144:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 784us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.366776:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:2.0:1788212040.370690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.370793:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846272 00000100:00100000:1.0:1788212040.370809:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846272 00000100:00100000:1.0:1788212040.370873:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:1.0:1788212040.370887:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16886:x1875075637846272:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788212040.371328:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16886:x1875075637846272:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 441us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212040.371338:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:2.0:1788212040.375562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.376224:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846400 00000100:00100000:3.0:1788212040.376243:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846400 00000100:00100000:3.0:1788212040.376400:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:3.0:1788212040.376416:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16896:x1875075637846400:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788212040.376818:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16896:x1875075637846400:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 404us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.376828:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:2.0:1788212040.393087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212040.395265:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846528 00000100:00100000:0.0:1788212040.395285:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846528 00000100:00100000:0.0:1788212040.395388:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:0.0:1788212040.395400:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16896:x1875075637846528:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788212040.395683:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16896:x1875075637846528:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 284us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212040.395691:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:2.0:1788212040.404945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.405333:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846656 00000100:00100000:3.0:1788212040.405345:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846656 00000100:00100000:3.0:1788212040.405487:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1788212040.405497:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875075637846656:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788212040.405527:0:18980:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 532a896b-a4e1-4980-8fe1-6a69ed7a7120@192.168.204.29@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1788212040.405568:0:18980:0:(genops.c:1385:class_connect()) connect: client 532a896b-a4e1-4980-8fe1-6a69ed7a7120, cookie 0x2afbce82f55a7051 00000004:00100000:3.0:1788212040.405598:0:18980:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788212040.405727:0:18980:0:(import.c:65:import_set_state_nolock()) ffff8abffdc18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788212040.405819:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2357:x1875075637846656:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 321us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.405827:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788212040.417547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212040.417585:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212040.425671:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846784 00000100:00100000:0.0:1788212040.425692:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846784 00000100:00080000:1.0:1788212040.426493:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788212040.426592:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637846912 00000100:00100000:0.0:1788212040.426599:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637846912 00000100:00100000:3.0:1788212040.426840:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788212040.426856:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+7:0:x1875075637846784:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788212040.426890:0:18979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788212040.427000:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+7:0:x1875075637846784:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 148us (9462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.427008:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788212040.427027:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788212040.427034:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637846912:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788212040.427044:0:18979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788212040.427066:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637846912:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 33us (9481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.427072:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788212040.432721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.433269:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847040 00000100:00100000:3.0:1788212040.433281:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847040 00000100:00100000:3.0:1788212040.433355:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1788212040.433368:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637847040:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788212040.433498:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637847040:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 131us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.433506:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788212040.436620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.436663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212040.436698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.436787:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847424 00000100:00100000:3.0:1788212040.436798:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847424 00000100:00100000:3.0:1788212040.436872:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1788212040.436900:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637847424:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788212040.437312:0:18983:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788212040.437606:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16886:x1875075637847424:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 707us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.437615:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1788212040.437783:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847168 00000100:00100000:2.0:1788212040.437789:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847168 00000100:00100000:2.0:1788212040.437820:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847296 00000100:00100000:2.0:1788212040.437823:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847296 00000100:00100000:2.0:1788212040.437847:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1788212040.437854:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875075637847168:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788212040.437878:0:19667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 532a896b-a4e1-4980-8fe1-6a69ed7a7120@192.168.204.29@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:2.0:1788212040.437906:0:19667:0:(genops.c:1385:class_connect()) connect: client 532a896b-a4e1-4980-8fe1-6a69ed7a7120, cookie 0x2afbce82f55a7058 00002000:00100000:2.0:1788212040.437917:0:19667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 532a896b-a4e1-4980-8fe1-6a69ed7a7120/ffff8ac00134b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788212040.437927:0:19667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788212040.438018:0:19667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788212040.438048:0:19667:0:(import.c:65:import_set_state_nolock()) ffff8ac00134c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788212040.438082:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2357:x1875075637847168:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 228us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212040.438089:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1788212040.438193:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788212040.438199:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875075637847296:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788212040.438215:0:19668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 532a896b-a4e1-4980-8fe1-6a69ed7a7120@192.168.204.29@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:0.0:1788212040.438235:0:19668:0:(genops.c:1385:class_connect()) connect: client 532a896b-a4e1-4980-8fe1-6a69ed7a7120, cookie 0x2afbce82f55a705f 00002000:00100000:0.0:1788212040.438241:0:19668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 532a896b-a4e1-4980-8fe1-6a69ed7a7120/ffff8abfe472a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788212040.438247:0:19668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788212040.438309:0:19668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788212040.438326:0:19668:0:(import.c:65:import_set_state_nolock()) ffff8abec7ce4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788212040.438352:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2357:x1875075637847296:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 152us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212040.438360:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1788212040.714848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212040.714961:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847552 00000100:00100000:3.0:1788212040.714975:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847552 00000100:00100000:3.0:1788212040.715046:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788212040.715058:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:16917:x1875075637847552:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:3.0:1788212040.715078:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212040.715104:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0c00/0x2afbce82f55a7066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e2b expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715247:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715264:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715280:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788212040.715560:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788212040.715564:0:18980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788212040.715656:0:18980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715689:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0c00/0x2afbce82f55a7066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 8 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715722:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 7 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212040.715731:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:3.0:1788212040.715734:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788212040.715737:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db0800, rc 0) 00000100:00100000:3.0:1788212040.715810:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+7:16917:x1875075637847552:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 754us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212040.715819:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000001:00100000:1.0:1788212041.075795:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac19d59b-b018-4eda-9f21-935367606cee 00000001:00100000:1.0:1788212041.075817:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 532a896b-a4e1-4980-8fe1-6a69ed7a7120 00010000:00010000:3.0:1788212041.381482:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212041.957375:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660910592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788212041.957457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212041.957542:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910592 00000100:00100000:3.0:1788212041.957551:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910592 00000100:00100000:3.0:1788212041.957621:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788212041.957629:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660910592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788212041.957668:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788212041.957728:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660910592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212041.957735:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788212041.957775:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788212041.957804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660910592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788212041.958121:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660910848:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212041.958216:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788212041.958236:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660910976:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212041.958300:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910848 00000100:00100000:2.0:1788212041.958304:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910848 00000100:00100000:2.0:1788212041.958344:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788212041.958353:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660910848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958395:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875075660910848:12345-0@lo:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212041.958403:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788212041.958423:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910976 00000100:00100000:2.0:1788212041.958426:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910976 00000100:00100000:2.0:1788212041.958453:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788212041.958460:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660910976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958491:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660910976:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212041.958497:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788212041.958532:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660910976:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958543:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875075660910848:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958562:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660911104:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212041.958605:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788212041.958611:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212041.958666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660911232:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212041.958746:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911104 00000100:00100000:2.0:1788212041.958751:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911104 00000100:00100000:2.0:1788212041.958776:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911232 00000100:00100000:2.0:1788212041.958780:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911232 00000100:00100000:2.0:1788212041.958796:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788212041.958802:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660911104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958839:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875075660911104:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212041.958845:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788212041.958857:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788212041.958864:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660911232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958889:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660911232:12345-0@lo:400:kworker.0 Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212041.958895:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788212041.958925:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660910720 00000100:00100000:2.0:1788212041.958929:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660910720 00000100:00100000:2.0:1788212041.958953:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788212041.958959:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660910720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.958985:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660910720:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212041.958991:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788212041.959028:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.959039:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660911232:0@lo:400:kworker.0 00000100:00100000:2.0:1788212041.959048:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875075660911104:0@lo:400:kworker.0 00000100:00080000:1.0:1788212041.959941:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788212041.959947:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788212041.959949:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788212042.005948:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 532a896b-a4e1-4980-8fe1-6a69ed7a7120 00000001:00100000:1.0:1788212042.006338:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac19d59b-b018-4eda-9f21-935367606cee 00010000:00010000:3.0:1788212042.410736:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788212042.602269:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ac19d59b-b018-4eda-9f21-935367606cee 00000001:00100000:3.0:1788212042.602297:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 532a896b-a4e1-4980-8fe1-6a69ed7a7120 00010000:00010000:0.0:1788212043.429986:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212044.457401:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788212044.517937:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788212044.517964:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660911360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788212044.518052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212044.518122:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911360 00000100:00100000:3.0:1788212044.518134:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911360 00000100:00100000:2.0:1788212044.518311:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788212044.518321:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660911360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788212044.518360:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788212044.518420:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660911360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212044.518427:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788212044.518480:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660911360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788212044.519002:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788212044.562011:0:20954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788212045.477441:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212045.529269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212045.529298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212045.529327:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847680 00000100:00100000:1.0:1788212045.529340:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847680 00000100:00100000:0.0:1788212045.529345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212045.529375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212045.529400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212045.529420:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:0.0:1788212045.529426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212045.529439:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac0010f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2360:x1875075637847680:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212045.529461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212045.529487:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847936 00000100:00100000:0.0:1788212045.529491:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847936 00000100:00100000:0.0:1788212045.529526:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848448 00000100:00100000:0.0:1788212045.529529:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848448 00000100:00100000:1.0:1788212045.529536:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac0010f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2360:x1875075637847680:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212045.529543:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848064 00000100:00100000:1.0:1788212045.529548:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:0.0:1788212045.529548:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848064 00000100:00100000:0.0:1788212045.529578:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848320 00000100:00100000:0.0:1788212045.529582:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848320 00000100:00100000:0.0:1788212045.529604:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788212045.529612:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+5:2360:x1875075637847936:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212045.529626:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788212045.529646:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2360:x1875075637848448:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212045.529652:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffde65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+5:2360:x1875075637847936:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212045.529661:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1788212045.529677:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:1.0:1788212045.529685:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2360:x1875075637848448:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212045.529687:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+5:2360:x1875075637848064:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212045.529695:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788212045.529727:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1788212045.529734:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+5:2360:x1875075637848064:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212045.529741:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2360:x1875075637848320:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212045.529748:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:1.0:1788212045.529773:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2360:x1875075637848320:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212045.529781:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788212045.530003:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848192 00000100:00100000:2.0:1788212045.530007:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848192 00000100:00100000:2.0:1788212045.530044:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637847808 00000100:00100000:2.0:1788212045.530046:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637847808 00000100:00100000:2.0:1788212045.530061:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788212045.530067:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2360:x1875075637848192:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788212045.530095:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2360:x1875075637848192:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212045.530101:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1788212045.530112:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788212045.530117:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:2360:x1875075637847808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788212045.530133:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+6:2360:x1875075637847808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 17us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212045.530139:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00080000:3.0:1788212045.532675:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788212045.532687:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788212045.532689:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788212045.991716:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788212046.501720:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212047.077491:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660911488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788212047.077577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212047.081106:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911488 00000100:00100000:3.0:1788212047.081128:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911488 00000100:00100000:3.0:1788212047.081894:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788212047.081909:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660911488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788212047.081961:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788212047.083786:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660911488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1870us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212047.083802:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788212047.083857:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660911616:0@lo:400:kworker.0 00000100:00080000:3.0:1788212047.083871:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788212047.083908:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660911744:0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.083939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212047.083955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212047.084011:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660911872:0@lo:400:kworker.0 00000100:00100000:3.0:1788212047.084039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212047.084248:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788212047.084257:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660912000:0@lo:400:kworker.0 00000100:00100000:3.0:1788212047.084284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212047.084319:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911744 00000100:00100000:3.0:1788212047.084329:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911744 00000100:00100000:3.0:1788212047.084412:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788212047.084424:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660911744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212047.084484:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660911744:12345-0@lo:400:kworker.0 Request processed in 63us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212047.084493:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788212047.085367:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911872 00000100:00100000:0.0:1788212047.085378:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911872 00000100:00100000:0.0:1788212047.085427:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912000 00000100:00100000:0.0:1788212047.085430:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912000 00000100:00100000:0.0:1788212047.085450:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788212047.085458:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212047.085525:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875075660911872:12345-0@lo:400:kworker.0 Request processed in 68us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212047.085533:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788212047.085548:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788212047.085554:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660912000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.085724:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660912128:0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.085759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212047.085791:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660911616 00000100:00100000:2.0:1788212047.085796:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660911616 00000100:00100000:2.0:1788212047.085837:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788212047.085844:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660911616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.085885:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3308:x1875075660911616:12345-0@lo:400:kworker.0 Request processed in 42us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212047.085891:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788212047.085944:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9c126b8-6169-4174-8e0e-db6a3254d2db:3308:1875075660911616:0@lo:400:kworker.0 00000100:00100000:0.0:1788212047.086927:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660912000:12345-0@lo:400:kworker.0 Request processed in 1368us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212047.086937:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788212047.086961:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912128 00000100:00100000:0.0:1788212047.086967:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912128 00000100:00080000:2.0:1788212047.088130:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788212047.088140:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788212047.088434:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788212047.088448:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660912128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788212047.088558:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875075660912128:12345-0@lo:400:kworker.0 Request processed in 114us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212047.088566:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788212047.088654:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660911488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788212047.089744:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788212047.089863:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875075660912128:0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.091531:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660911744:0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.095133:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660912000:0@lo:400:kworker.0 00000100:00100000:2.0:1788212047.095163:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875075660911872:0@lo:400:kworker.0 00010000:00010000:3.0:1788212047.525528:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788212048.553655:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788212049.299331:0:21103:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc17aea9b0 20000000:00000080:2.0:1788212049.299351:0:21103:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac00075a400 uarg=0000000000000000 20000000:01000000:2.0:1788212049.299389:0:21103:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788212049.299395:0:21103:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788212049.299400:0:21103:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788212049.312920:0:21104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788212049.313368:0:21103:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788212049.327982:0:21103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788212049.328132:0:21103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328324:0:21103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328333:0:21103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328341:0:21103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 18 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328351:0:21103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328360:0:21103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328368:0:21103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328558:0:21103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328644:0:21103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.328662:0:21103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912256:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788212049.328841:0:21103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 12 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328851:0:21103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 12 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.328871:0:21103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912384:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788212049.328906:0:21103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 18 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.328914:0:21103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 18 pid: 18971 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.328923:0:21103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912512:0@lo:104: 00000100:00100000:1.0:1788212049.328970:0:21103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788212049.329021:0:21103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.329029:0:21103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 18 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.329038:0:21103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912640:0@lo:104: 00000100:00100000:1.0:1788212049.329059:0:21103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788212049.329092:0:21103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.329101:0:21103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 18 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.329109:0:21103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912768:0@lo:104: 00000100:00100000:1.0:1788212049.329135:0:21103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212049.329145:0:21103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788212049.329249:0:18962:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788212049.329263:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912512 00000100:00100000:0.0:1788212049.329270:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912512 00000100:00100000:0.0:1788212049.329309:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912640 00000100:00100000:0.0:1788212049.329312:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912640 00000100:00100000:0.0:1788212049.329322:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912768 00000100:00100000:0.0:1788212049.329324:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912768 00000100:00100000:0.0:1788212049.329337:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788212049.329346:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:21103:x1875075660912512:12345-0@lo:104: 00010000:00010000:0.0:1788212049.329359:0:18962:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329430:0:18962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788212049.329446:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+5:21103:x1875075660912512:12345-0@lo:104: Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212049.329453:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788212049.329471:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788212049.329477:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+4:21103:x1875075660912640:12345-0@lo:104: 00010000:00010000:0.0:1788212049.329484:0:18962:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329516:0:18962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788212049.329521:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+4:21103:x1875075660912640:12345-0@lo:104: Request processed in 45us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212049.329527:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788212049.329548:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788212049.329554:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:21103:x1875075660912768:12345-0@lo:104: 00010000:00010000:0.0:1788212049.329562:0:18962:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329608:0:18962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788212049.329614:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9c126b8-6169-4174-8e0e-db6a3254d2db+3:21103:x1875075660912768:12345-0@lo:104: Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212049.329620:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788212049.329662:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788212049.329668:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329676:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07a00 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788212049.329682:0:18967:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329691:0:18967:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788212049.329699:0:18967:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788212049.329706:0:18967:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788212049.329740:0:18967:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329747:0:18967:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788212049.329780:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329798:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b07a00/0x2afbce82f55a6ec9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6ed0 expref: -99 pid: 20389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329813:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788212049.329816:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329823:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06800 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788212049.329826:0:18967:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329833:0:18967:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788212049.329839:0:18967:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788212049.329844:0:18967:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788212049.329858:0:18967:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329865:0:18967:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788212049.329881:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329889:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06800/0x2afbce82f55a6d79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d80 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329898:0:18967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212049.329907:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329913:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81000 already unused, calling callback (ffffffffc1d37c20) 10000000:00010000:0.0:1788212049.329916:0:18967:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.329923:0:18967:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.329985:0:21103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912512:0@lo:104: 00000100:00100000:1.0:1788212049.329995:0:21103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001240000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912640:0@lo:104: 00000100:00100000:1.0:1788212049.330011:0:21103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912768:0@lo:104: 00000100:00100000:1.0:1788212049.330263:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660912896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788212049.330300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788212049.330355:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212049.330361:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212049.330529:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660912896 00000100:00100000:3.0:1788212049.330535:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660912896 00010000:00010000:3.0:1788212049.330646:0:18965:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 19 pid: 18971 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212049.330683:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788212049.330694:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3309:x1875075660912896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788212049.330711:0:18965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212049.330717:0:18965:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 19 pid: 18971 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212049.330728:0:18965:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 19 pid: 18971 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212049.330746:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0030400/0x2afbce82f55a6ed0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6ec9 expref: 19 pid: 18971 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212049.330761:0:18965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788212049.330817:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:3309:x1875075660912896:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212049.330824:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788212049.330998:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9c126b8-6169-4174-8e0e-db6a3254d2db:3309:1875075660912896:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1788212049.331418:0:18967:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788212049.331424:0:18967:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788212049.331473:0:18967:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.331479:0:18967:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788212049.331489:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.331495:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff8abffdb81000/0x2afbce82f55a6d2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2afbce82f55a6d33 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212049.331512:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212049.331513:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212049.331515:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212049.331528:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660913024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788212049.331561:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212049.331606:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913024 00000100:00100000:0.0:1788212049.331608:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788212049.331611:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913024 00000100:00100000:0.0:1788212049.331613:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660913152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788212049.331632:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 18 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212049.331643:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212049.331949:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913152 00000100:00100000:2.0:1788212049.331953:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913152 00010000:00010000:2.0:1788212049.331968:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 19 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212049.331983:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788212049.331990:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3310:x1875075660913024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788212049.332001:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212049.332006:0:18966:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 19 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332014:0:18966:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 19 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332026:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a6d80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6d79 expref: 19 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332037:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212049.332077:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:3310:x1875075660913024:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212049.332084:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788212049.332099:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788212049.332106:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:3310:x1875075660913152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788212049.332113:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212049.332117:0:18966:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 17 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332124:0:18966:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 17 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332141:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06000/0x2afbce82f55a6d33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2afbce82f55a6d2c expref: 17 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.332149:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212049.332197:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:3310:x1875075660913152:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212049.332294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660913152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788212049.332303:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660913024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788212049.332841:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788212049.335822:0:21103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912256:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788212049.335842:0:21103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001241c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21103:1875075660912384:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788212049.335893:0:21103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212049.337715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212049.337821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212049.339455:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848704 00000100:00100000:2.0:1788212049.339475:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848704 00010000:00010000:2.0:1788212049.339618:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 13 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212049.339661:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848576 00000100:00100000:2.0:1788212049.339667:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848576 00010000:00010000:2.0:1788212049.339682:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 14 pid: 18974 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212049.339776:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788212049.339790:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d0ecf5-5943-42bf-82b5-6e0157b29789+14:2358:x1875075637848704:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788212049.339809:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212049.339817:0:18966:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 14 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.339841:0:18966:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 14 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.339867:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfc0031a00/0x2afbce82f55a7012 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5d9f expref: 14 pid: 18973 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.339918:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212049.340006:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2358:x1875075637848704:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 218us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212049.340090:0:18965:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788212049.340102:0:18965:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788212049.342326:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1788212049.342340:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788212049.342356:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2358:x1875075637848576:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788212049.342377:0:18964:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788212049.342387:0:18964:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342404:0:18964:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342423:0:18964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abec7db1a00/0x2afbce82f55a704a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e01 expref: 12 pid: 18974 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342443:0:18964:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342450:0:18964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342488:0:18964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342496:0:18964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342503:0:18964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342510:0:18964:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342517:0:18964:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212049.342522:0:18964:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342531:0:18964:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342558:0:18964:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212049.342569:0:18964:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788212049.342707:0:21103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.342717:0:21103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212049.342722:0:21103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8abfd2b06200/0x2afbce82f55a7074 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212049.344389:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:2358:x1875075637848576:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2038us (6556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212049.344405:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:1.0:1788212049.575369:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212049.637420:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788212049.643359:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660913280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788212049.643495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212049.643707:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913280 00000100:00100000:3.0:1788212049.643719:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913280 00000100:00080000:0.0:1788212049.643810:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788212049.643828:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788212049.643848:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660913280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788212049.643905:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788212049.643969:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660913280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212049.643978:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788212049.644545:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660913280:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788212050.469377:0:18976:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788212050.469394:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfe472e000 from 10 10000000:01000000:1.0:1788212050.469404:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788212050.469492:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212050.469512:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212050.469532:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212050.469602:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788212050.469711:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212050.469819:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788212050.472006:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913408 00000100:00100000:2.0:1788212050.472024:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913408 00000100:00100000:2.0:1788212050.472106:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788212050.472118:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+16:18976:x1875075660913408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788212050.472138:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212050.472219:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a7082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a707b expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.472250:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a7082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a707b expref: 17 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.472260:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abffdb80e00/0x2afbce82f55a7082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a707b expref: 17 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.472268:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80e00, rc 0) 00000100:00100000:2.0:1788212050.472374:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212050.472381:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788212050.472714:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788212050.472732:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7082 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212050.472751:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a7082 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212050.472822:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788212050.472871:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212050.472904:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788212050.473481:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913536 00000100:00100000:2.0:1788212050.473489:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913536 00000100:00100000:2.0:1788212050.473531:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788212050.473540:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.473823:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212050.473830:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788212050.474158:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788212050.474235:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788212050.474278:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212050.474309:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff7104d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788212050.474417:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913664 00000100:00100000:0.0:1788212050.474422:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913664 00000100:00100000:0.0:1788212050.474456:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788212050.474464:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788212050.474633:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212050.474640:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788212050.475775:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001243b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788212050.477819:0:21117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788212050.479644:0:18976:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788212050.479685:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788212050.479701:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7082 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212050.479714:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abfd2b06e00/0x2afbce82f55a707b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7082 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788212050.479725:0:18976:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788212050.479728:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfe472b000 from 10 10000000:01000000:3.0:1788212050.479730:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788212050.479787:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212050.479795:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212050.479808:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212050.479975:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788212050.480076:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212050.480328:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752600 going to sleep for 11 seconds 00000100:00100000:0.0:1788212050.487475:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913792 00000100:00100000:0.0:1788212050.487495:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913792 00000100:00100000:0.0:1788212050.487617:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788212050.487630:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+17:18976:x1875075660913792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212050.487653:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212050.487680:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a7090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a7089 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.487713:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a7090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a7089 expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.487725:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4a00/0x2afbce82f55a7090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a7089 expref: 18 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.487769:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4a00, rc 0) 00000100:00100000:0.0:1788212050.487881:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660913792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212050.487888:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788212050.487995:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788212050.488014:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7090 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212050.488025:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a7090 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212050.488124:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788212050.488211:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212050.489829:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abec6752600 going to sleep for 11 seconds 00000100:00100000:2.0:1788212050.494978:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660913920 00000100:00100000:2.0:1788212050.494997:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660913920 00000100:00100000:3.0:1788212050.495391:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788212050.495404:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660913920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788212050.495737:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660913920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (7525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212050.495755:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788212050.496085:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abec665ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660913920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.496136:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.496359:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212050.496395:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc55210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788212050.496483:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660914048 00000100:00100000:3.0:1788212050.496489:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660914048 00000100:00100000:3.0:1788212050.496555:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788212050.496563:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660914048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788212050.496723:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660914048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212050.496750:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788212050.496910:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788212050.497597:0:21118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788212050.497654:0:18976:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788212050.497674:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788212050.497686:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7090 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.497696:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abec7db0c00/0x2afbce82f55a7089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a7090 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788212050.497706:0:18976:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788212050.497718:0:18976:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8abfd0b3f800 from 10 10000000:01000000:2.0:1788212050.497721:0:18976:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788212050.497761:0:18976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.497770:0:18976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.497779:0:18976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212050.497796:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.497836:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212050.498511:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5521480 going to sleep for 11 seconds 00000100:00100000:0.0:1788212050.503580:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660914176 00000100:00100000:0.0:1788212050.503595:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660914176 00000100:00100000:0.0:1788212050.503657:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788212050.503667:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+18:18976:x1875075660914176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212050.503685:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212050.503703:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a709e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2afbce82f55a7097 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.503730:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2afbce82f55a7097 expref: 19 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.503754:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4200/0x2afbce82f55a709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2afbce82f55a7097 expref: 19 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.503764:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4200, rc 0) 00000100:00100000:0.0:1788212050.503856:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660914176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (6020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212050.503969:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788212050.503988:0:18976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a709e expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212050.503999:0:18976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2afbce82f55a709e expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212050.504087:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.504127:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212050.504156:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5521480 going to sleep for 11 seconds 00000100:00100000:0.0:1788212050.504464:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788212050.504496:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660914304 00000100:00100000:0.0:1788212050.504501:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660914304 00000100:00100000:0.0:1788212050.504519:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788212050.504524:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660914304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788212050.505114:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660914304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 586us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212050.505131:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788212050.505308:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.505346:0:18976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788212050.505389:0:18976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212050.505401:0:18976:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc5521480 going to sleep for 11 seconds 00000100:00100000:3.0:1788212050.505461:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660914432 00000100:00100000:3.0:1788212050.505466:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660914432 00000100:00100000:3.0:1788212050.505492:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788212050.505498:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660914432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788212050.505659:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:18976:x1875075660914432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212050.505665:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788212050.506007:0:18976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9c126b8-6169-4174-8e0e-db6a3254d2db:18976:1875075660914432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788212050.506989:0:21119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788212050.507311:0:18976:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788212050.507335:0:18976:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788212050.507345:0:18976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a709e expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212050.507356:0:18976:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff8abffdb80600/0x2afbce82f55a7097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2afbce82f55a709e expref: -99 pid: 18976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212050.597690:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212050.649342:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212050.649444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212050.649475:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212050.649516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212050.649546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212050.649566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212050.649622:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849216 00000100:00100000:1.0:1788212050.649635:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849216 00000100:00100000:1.0:1788212050.649720:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849472 00000100:00100000:1.0:1788212050.649724:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849472 00000100:00100000:1.0:1788212050.649750:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849088 00000100:00100000:1.0:1788212050.649754:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849088 00000100:00100000:1.0:1788212050.649777:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788212050.649788:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2358:x1875075637849216:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212050.649874:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2358:x1875075637849216:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 87us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212050.649882:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1788212050.649902:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1788212050.649909:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2358:x1875075637849472:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212050.649934:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2358:x1875075637849472:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212050.649940:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1788212050.649952:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1788212050.649958:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2358:x1875075637849088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212050.649979:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2358:x1875075637849088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 21us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212050.650000:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00080000:1.0:1788212050.650148:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788212050.650152:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788212050.650267:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848832 00000100:00100000:3.0:1788212050.650272:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848832 00000100:00100000:3.0:1788212050.650315:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:3.0:1788212050.650324:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:2358:x1875075637848832:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788212050.650358:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:2358:x1875075637848832:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212050.650364:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1788212050.651427:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212050.651546:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849600 00000100:00100000:3.0:1788212050.651553:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849600 00000100:00100000:3.0:1788212050.651612:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788212050.651621:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2358:x1875075637849600:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1788212050.651682:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2358:x1875075637849600:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 62us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212050.651688:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00080000:0.0:1788212050.653214:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788212050.655132:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637848960 00000100:00100000:1.0:1788212050.655132:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849344 00000100:00100000:1.0:1788212050.655146:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849344 00000100:00100000:2.0:1788212050.655151:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637848960 00000100:00080000:0.0:1788212050.655249:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212050.655271:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1788212050.655286:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:2358:x1875075637848960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1788212050.655379:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:2358:x1875075637848960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 99us (6046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212050.655387:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:1.0:1788212050.656088:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1788212050.656098:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2358:x1875075637849344:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212050.656190:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2358:x1875075637849344:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 70us (6598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212050.656198:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00080000:0.0:1788212050.656849:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788212051.034151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.034324:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849728 00000100:00100000:0.0:1788212051.034341:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849728 00000100:00100000:0.0:1788212051.034420:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:0.0:1788212051.034433:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+11:16768:x1875075637849728:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788212051.034453:0:18971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.034476:0:18971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a70a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e32 expref: -99 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.034510:0:18971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a70a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e32 expref: 12 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.034548:0:18971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfc13c4e00/0x2afbce82f55a70a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e32 expref: 12 pid: 18971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.034560:0:18971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4e00, rc 0) 00000100:00100000:0.0:1788212051.034635:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637849728:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 205us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.034643:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:2.0:1788212051.044638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.045205:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849856 00000100:00100000:1.0:1788212051.045218:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849856 00000100:00100000:1.0:1788212051.045279:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:1.0:1788212051.045290:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637849856:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788212051.045742:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637849856:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 442us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.045752:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:1.0:1788212051.049045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212051.049231:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637849984 00000100:00100000:3.0:1788212051.049245:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637849984 00000100:00100000:3.0:1788212051.049340:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:3.0:1788212051.049353:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637849984:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788212051.052539:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637849984:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 3183us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.052551:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:2.0:1788212051.083836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.086901:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850112 00000100:00100000:1.0:1788212051.086928:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850112 00000100:00100000:1.0:1788212051.087030:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:1.0:1788212051.087041:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+12:16768:x1875075637850112:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788212051.087057:0:18973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212051.087077:0:18973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a70ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e39 expref: -99 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.087129:0:18973:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a70ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e39 expref: 13 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.087140:0:18973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8abfd2b07200/0x2afbce82f55a70ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e39 expref: 13 pid: 18973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.087151:0:18973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07200, rc 0) 00000100:00100000:1.0:1788212051.087257:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16768:x1875075637850112:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 218us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.087264:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:0.0:1788212051.105957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.106131:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850240 00000100:00100000:2.0:1788212051.106143:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850240 00000100:00100000:2.0:1788212051.106253:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:2.0:1788212051.106267:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfffccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16768:x1875075637850240:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788212051.106639:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfffccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16768:x1875075637850240:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 373us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.106649:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:3.0:1788212051.112028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.112139:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850368 00000100:00100000:0.0:1788212051.112161:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850368 00000100:00100000:0.0:1788212051.112279:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:0.0:1788212051.112291:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16768:x1875075637850368:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788212051.113474:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:16768:x1875075637850368:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 1170us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.113485:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:1.0:1788212051.123427:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.123650:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850496 00000100:00100000:2.0:1788212051.123661:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850496 00000100:00100000:2.0:1788212051.123833:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1788212051.123846:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+6:17381:x1875075637850496:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212051.123891:0:18979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212051.125679:0:18979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a70b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e40 expref: -99 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.125772:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.125786:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.125920:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.125937:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.126020:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.126030:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127099:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a70c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127117:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a70c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127129:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a70c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788212051.127505:0:18979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788212051.127517:0:18979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788212051.127616:0:18979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a70c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127629:0:18979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127636:0:18979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127643:0:18979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127648:0:18979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212051.127652:0:18979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127659:0:18979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127851:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:2.0:1788212051.127854:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788212051.127860:0:18979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127867:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a70ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127882:0:18979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127888:0:18979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127905:0:18979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127910:0:18979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212051.127913:0:18979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127919:0:18979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127926:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ac00206eb00) 00010000:00010000:2.0:1788212051.127929:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788212051.127931:0:18979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.127936:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a70c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.128069:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a70b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e40 expref: 8 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.128087:0:18979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81200/0x2afbce82f55a70c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e40 expref: 7 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.128095:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac00206e400) 00010000:00010000:2.0:1788212051.128097:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788212051.128100:0:18979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81200, rc 0) 00000100:00100000:2.0:1788212051.128565:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+7:17381:x1875075637850496:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 4719us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.128585:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1788212051.138368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.139093:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850752 00000100:00100000:0.0:1788212051.139106:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850752 00000100:00100000:0.0:1788212051.139205:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788212051.139218:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+7:17381:x1875075637850752:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788212051.139247:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.139276:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a70cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e47 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139559:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139594:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139607:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139624:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139632:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.139639:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.143784:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5a00/0x2afbce82f55a70e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.143811:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5a00/0x2afbce82f55a70e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.143824:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5a00/0x2afbce82f55a70e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.143837:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788212051.144557:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144569:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144576:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144588:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.144593:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144601:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144617:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac00206e400) 00010000:00010000:0.0:1788212051.144620:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.144625:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144631:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a70d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144646:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144652:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144658:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144724:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.144736:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144743:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144764:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8abfdb434f00) 00010000:00010000:0.0:1788212051.144767:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.144770:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.144776:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.148814:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a70cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e47 expref: 10 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.148847:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5a00/0x2afbce82f55a70e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e47 expref: 9 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.148858:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434c00) 00010000:00010000:0.0:1788212051.148862:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.148866:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c5a00, rc 0) 00000100:00100000:0.0:1788212051.150245:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+9:17381:x1875075637850752:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 11017us (11876us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788212051.150259:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1788212051.165658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.165747:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637850880 00000100:00100000:2.0:1788212051.165758:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637850880 00000100:00100000:2.0:1788212051.165827:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1788212051.165840:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+9:17381:x1875075637850880:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788212051.166013:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+9:17381:x1875075637850880:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 176us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.166546:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1788212051.211354:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.211471:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851008 00000100:00100000:0.0:1788212051.211483:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851008 00000100:00100000:0.0:1788212051.211549:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1788212051.211563:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+9:17388:x1875075637851008:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.211588:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.211615:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a70f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e4e expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211757:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211776:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211790:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211807:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211813:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.211819:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212356:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212366:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212373:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212380:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c5c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.212385:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212404:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212421:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:0.0:1788212051.212424:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.212430:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212436:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a70f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212452:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212458:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212465:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212470:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.212473:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212479:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212486:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8abfdb434f00) 00010000:00010000:0.0:1788212051.212488:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.212491:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212508:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a7100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212553:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a70f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e4e expref: 10 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212566:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:0.0:1788212051.212568:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.212571:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a70f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e4e expref: 10 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.212581:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4000, rc 0) 00000100:00100000:0.0:1788212051.212670:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+9:17388:x1875075637851008:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1110us (1335us total) trans 0 rc 301/301 00000100:00100000:0.0:1788212051.212679:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1788212051.221580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.221774:0:18988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851136 00000100:00100000:1.0:1788212051.221788:0:18988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851136 00000100:00100000:1.0:1788212051.222004:0:18988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788212051.222016:0:18988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac19d59b-b018-4eda-9f21-935367606cee+9:17388:x1875075637851136:12345-192.168.204.29@tcp:700:lfs.0 00000100:00100000:1.0:1788212051.222125:0:18988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac19d59b-b018-4eda-9f21-935367606cee+9:17388:x1875075637851136:12345-192.168.204.29@tcp:700:lfs.0 Request processed in 112us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.222132:0:18988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788212051.225585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.225759:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851392 00000100:00100000:2.0:1788212051.225774:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851392 00000100:00100000:2.0:1788212051.225977:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1788212051.225990:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+9:17388:x1875075637851392:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:2.0:1788212051.226077:0:18979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212051.226296:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0000/0x2afbce82f55a7035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5dc9 expref: 9 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.226325:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:2.0:1788212051.226331:0:18979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788212051.226910:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.226932:0:18979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 5 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.226942:0:18979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.226994:0:18979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 5 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.227012:0:18979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 5 pid: 18980 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.227029:0:18979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18979:1875075660914560:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788212051.228071:0:18979:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4b933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788212051.236436:0:18979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18979:1875075660914560:192.168.204.29@tcp:104: 00010000:00010000:2.0:1788212051.236486:0:18979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212051.239448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.239515:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851520 00000100:00100000:2.0:1788212051.239527:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851520 00010000:00010000:2.0:1788212051.239573:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 6 pid: 18980 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.239617:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1788212051.239627:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2359:x1875075637851520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788212051.239641:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212051.239649:0:18966:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 6 pid: 18980 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239664:0:18966:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 6 pid: 18980 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239711:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db0800/0x2afbce82f55a706d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e2b expref: 6 pid: 18980 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239738:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:2.0:1788212051.239744:0:18966:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239753:0:18966:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239759:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.239797:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212051.239856:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2359:x1875075637851520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 231us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.239865:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00010000:00010000:0.0:1788212051.239937:0:18979:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.239945:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.239982:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.239992:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.240000:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.245119:0:18979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788212051.245290:0:18979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245304:0:18979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245312:0:18979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245319:0:18979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.245324:0:18979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245334:0:18979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245352:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfcda7a000) 00010000:00010000:0.0:1788212051.245355:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.245359:0:18979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.245366:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a7107 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788212051.245389:0:18979:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abfb217b reply state 00000000bcdac6c1 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212051.245399:0:18979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788212051.245588:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+10:17388:x1875075637851392:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 19596us (20012us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788212051.245614:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:2.0:1788212051.252046:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252067:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252075:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252082:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfc13c4400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212051.252086:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252113:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252131:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8abfdb434f00) 00010000:00010000:2.0:1788212051.252134:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788212051.252140:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.252159:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a710e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212051.353313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.353531:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851648 00000100:00100000:0.0:1788212051.353544:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851648 00000100:00100000:0.0:1788212051.353620:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:0.0:1788212051.353634:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+9:17396:x1875075637851648:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:0.0:1788212051.353665:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.353697:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a7115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e55 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.353787:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a711c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.353802:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a711c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.353813:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a711c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.353895:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788212051.353899:0:18981:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1788212051.353950:0:18981:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a711c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.353981:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a7115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e55 expref: 11 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.354004:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4400/0x2afbce82f55a711c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e55 expref: 10 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.354040:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788212051.354043:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788212051.354049:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4400, rc 0) 00000100:00100000:0.0:1788212051.354267:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+10:17396:x1875075637851648:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 636us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.354276:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1788212051.416499:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.420015:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851776 00000100:00100000:0.0:1788212051.420033:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851776 00000100:00100000:0.0:1788212051.420414:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:0.0:1788212051.420426:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:17397:x1875075637851776:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.420447:0:18979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.420468:0:18979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a7123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e5c expref: -99 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420540:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a712a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420554:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a712a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420565:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a712a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.420621:0:18979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788212051.420624:0:18979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1788212051.420648:0:18979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a712a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420704:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a7123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e5c expref: 7 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420735:0:18979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c4000/0x2afbce82f55a712a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e5c expref: 6 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.420744:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788212051.420747:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788212051.420750:0:18979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c4000, rc 0) 00000100:00100000:0.0:1788212051.420829:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:17397:x1875075637851776:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 406us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.420836:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1788212051.425656:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.425876:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637851904 00000100:00100000:1.0:1788212051.425943:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637851904 00000100:00100000:1.0:1788212051.426035:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1788212051.426060:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:17397:x1875075637851904:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788212051.426081:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212051.426104:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a7131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e63 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426200:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426214:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426321:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426337:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426344:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426351:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426450:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426458:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426465:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788212051.426514:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788212051.426517:0:18980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788212051.426540:0:18980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426552:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426559:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426566:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426572:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212051.426576:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426584:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426597:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788212051.426599:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788212051.426603:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426609:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426622:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426638:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426643:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426647:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212051.426650:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426656:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426663:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8abfc37ecc00) 00010000:00010000:1.0:1788212051.426665:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788212051.426668:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426673:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a713f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426966:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a7131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e63 expref: 8 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426982:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e63 expref: 7 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.426989:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788212051.426991:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788212051.426999:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b07600, rc 0) 00000100:00100000:1.0:1788212051.427126:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+7:17397:x1875075637851904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1067us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.427135:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1788212051.433834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.433987:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637852160 00000100:00100000:0.0:1788212051.433998:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637852160 00000100:00100000:0.0:1788212051.434095:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1788212051.434106:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+7:17397:x1875075637852160:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.434127:0:18979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.434161:0:18979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5e00/0x2afbce82f55a714d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e6a expref: -99 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.434495:0:18979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788212051.434607:0:18979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5e00/0x2afbce82f55a714d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e6a expref: 9 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.434622:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788212051.434625:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788212051.434639:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5e00/0x2afbce82f55a714d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e6a expref: 9 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.434651:0:18979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfc13c5e00, rc 0) 00000100:00100000:0.0:1788212051.434732:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+8:17397:x1875075637852160:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 616us (1033us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788212051.434740:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:2.0:1788212051.438435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.438518:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637852416 00000100:00100000:1.0:1788212051.438532:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637852416 00000100:00100000:1.0:1788212051.438598:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:1.0:1788212051.438611:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+8:17397:x1875075637852416:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1788212051.438675:0:18980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788212051.438716:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a7146 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e63 expref: 8 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.438749:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfc37ec900) 00010000:00010000:1.0:1788212051.438761:0:18980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788212051.438796:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.438810:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.438819:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788212051.439098:0:18980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a15d2d8 reply state 000000006ad5af9e transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212051.439109:0:18980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788212051.439122:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788212051.439731:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+9:17397:x1875075637852416:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1112us (1298us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788212051.439758:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1788212051.445738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.446015:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637852672 00000100:00100000:1.0:1788212051.446026:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637852672 00000100:00100000:1.0:1788212051.446086:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788212051.446097:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+9:17397:x1875075637852672:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788212051.446409:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+10:17397:x1875075637852672:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 313us (693us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788212051.446418:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00010000:00010000:0.0:1788212051.451022:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451047:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451056:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451061:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.451067:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451074:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451093:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfc37ec300) 00010000:00010000:0.0:1788212051.451096:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788212051.451101:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.451106:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06000/0x2afbce82f55a715b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.452611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.452761:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637852928 00000100:00100000:1.0:1788212051.452785:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637852928 00000100:00100000:1.0:1788212051.452858:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:1.0:1788212051.452867:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+9:17397:x1875075637852928:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1788212051.452904:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212051.452925:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a7162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e71 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453007:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453022:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453034:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453049:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453076:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453082:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788212051.453623:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788212051.453754:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453764:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453782:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453787:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212051.453791:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453798:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453811:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788212051.453814:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788212051.453818:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.453823:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07400/0x2afbce82f55a7169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454095:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454101:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454107:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454112:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212051.454115:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454121:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454130:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8abfc37ecc00) 00010000:00010000:1.0:1788212051.454132:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788212051.454135:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454154:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07a00/0x2afbce82f55a7170 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454631:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a7162 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e71 expref: 11 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454644:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:1.0:1788212051.454647:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788212051.454659:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06800/0x2afbce82f55a7162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e71 expref: 11 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.454669:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06800, rc 0) 00000100:00100000:1.0:1788212051.459737:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+10:17397:x1875075637852928:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1905us (2172us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788212051.459753:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1788212051.461662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.462591:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853056 00000100:00100000:0.0:1788212051.462624:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853056 00000100:00100000:0.0:1788212051.462820:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:0.0:1788212051.462843:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+10:17397:x1875075637853056:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.462871:0:18979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.462903:0:18979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a717e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e78 expref: -99 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463016:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463032:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463045:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.463098:0:18979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788212051.463102:0:18979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788212051.463125:0:18979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463198:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfc13c5c00/0x2afbce82f55a717e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 12 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463218:0:18979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 11 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.463226:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfdb434000) 00010000:00010000:0.0:1788212051.463229:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788212051.463233:0:18979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cda00, rc 0) 00000100:00100000:0.0:1788212051.463301:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+11:17397:x1875075637853056:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 471us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.466662:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1788212051.468367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.468619:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853184 00000100:00100000:1.0:1788212051.468634:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853184 00000100:00100000:1.0:1788212051.468880:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1788212051.468904:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+11:17397:x1875075637853184:12345-192.168.204.29@tcp:37:lfs.0 00000100:00100000:1.0:1788212051.474105:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532a896b-a4e1-4980-8fe1-6a69ed7a7120+11:17397:x1875075637853184:12345-192.168.204.29@tcp:37:lfs.0 Request processed in 5191us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.474120:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788212051.480870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212051.481020:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853440 00000100:00100000:3.0:1788212051.481033:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853440 00000100:00100000:3.0:1788212051.481111:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1788212051.481124:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd0b1b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+11:17397:x1875075637853440:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788212051.481494:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd0b1b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:532a896b-a4e1-4980-8fe1-6a69ed7a7120+12:17397:x1875075637853440:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 370us (634us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788212051.481502:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1788212051.559322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.559481:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853568 00000100:00100000:0.0:1788212051.559492:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853568 00000100:00100000:0.0:1788212051.559560:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788212051.559571:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+10:17403:x1875075637853568:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1788212051.559591:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.559611:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a718c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e7f expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559681:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559696:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559707:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559736:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559744:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559750:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559859:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc200/0x2afbce82f55a71a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559882:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc200/0x2afbce82f55a71a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559889:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc200/0x2afbce82f55a71a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.559928:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788212051.559932:0:18980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788212051.559982:0:18980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc200/0x2afbce82f55a71a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.559996:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560003:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560009:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560016:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cdc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.560021:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560029:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560043:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788212051.560047:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.560051:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560069:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cdc00/0x2afbce82f55a7193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560084:0:18980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560089:0:18980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560095:0:18980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560100:0:18980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8ccc00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.560103:0:18980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560108:0:18980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560115:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8abfdb434100) 00010000:00010000:0.0:1788212051.560118:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.560120:0:18980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560126:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a719a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560639:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a718c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e7f expref: 12 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560669:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc200/0x2afbce82f55a71a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e7f expref: 11 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.560678:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfdb434000) 00010000:00010000:0.0:1788212051.560681:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788212051.560683:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc200, rc 0) 00000100:00100000:0.0:1788212051.560762:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+11:17403:x1875075637853568:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1192us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.560771:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1788212051.566260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.566509:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853824 00000100:00100000:2.0:1788212051.566519:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853824 00000100:00100000:2.0:1788212051.566586:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:2.0:1788212051.566598:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+11:17403:x1875075637853824:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1788212051.566625:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212051.566651:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71a8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e86 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.566831:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.566867:0:18981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 11 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.566876:0:18981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.566915:0:18981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 11 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.566930:0:18981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 11 pid: 18979 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.566944:0:18981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18981:1875075660914688:192.168.204.29@tcp:104: 00000100:00100000:2.0:1788212051.567327:0:18981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfc4b933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212051.580785:0:18981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18981:1875075660914688:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788212051.580840:0:18981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212051.590877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.591549:0:21105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637853952 00000100:00100000:2.0:1788212051.591562:0:21105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637853952 00010000:00010000:2.0:1788212051.591618:0:21105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 12 pid: 18979 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.591669:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788212051.591682:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+12:2359:x1875075637853952:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788212051.591701:0:21105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212051.591732:0:21105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 12 pid: 18979 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.591750:0:21105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 12 pid: 18979 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.591809:0:21105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cda00/0x2afbce82f55a7185 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e78 expref: 12 pid: 18979 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.591844:0:21105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfdb434000) 00010000:00010000:2.0:1788212051.591849:0:21105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.591862:0:21105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.591870:0:21105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.592064:0:21105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212051.592339:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+11:2359:x1875075637853952:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 658us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.592348:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:0.0:1788212051.592666:0:18981:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.592677:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.592708:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.592733:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.592744:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594501:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594525:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594537:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.594551:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788212051.594583:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594590:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594596:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594601:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81a00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212051.594606:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594613:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594625:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfdb434000) 00010000:00010000:0.0:1788212051.594628:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212051.594632:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594652:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a71af lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788212051.594671:0:18981:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000513b2fa8 reply state 00000000a0f99556 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212051.594684:0:18981:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788212051.594742:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71a8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 14 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594756:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 13 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.594763:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788212051.594765:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788212051.594768:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8ccc00, rc 0) 00000100:00100000:0.0:1788212051.594872:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+14:17403:x1875075637853824:12345-192.168.204.29@tcp:101:bash.0 Request processed in 28275us (28621us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788212051.594892:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00010000:00010000:2.0:1788212051.598826:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598853:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598864:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598870:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cca00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212051.598877:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598920:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598944:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8abfdb434100) 00010000:00010000:2.0:1788212051.598947:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788212051.598954:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.598962:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cca00/0x2afbce82f55a71b6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212051.620212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.620676:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637854080 00000100:00100000:1.0:1788212051.620691:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637854080 00000100:00100000:1.0:1788212051.620850:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1788212051.620864:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+13:17403:x1875075637854080:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1788212051.620900:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788212051.620926:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a71cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e8d expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621048:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621065:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621094:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788212051.621130:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788212051.621134:0:18980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788212051.621163:0:18980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621207:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621238:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07600/0x2afbce82f55a71cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 15 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621260:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 14 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212051.621270:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788212051.621273:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788212051.621278:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfd2b06200, rc 0) 00010000:00010000:0.0:1788212051.621285:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212051.621350:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+14:17403:x1875075637854080:12345-192.168.204.29@tcp:101:bash.0 Request processed in 489us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212051.621357:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1788212051.625529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212051.625626:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637854336 00000100:00100000:3.0:1788212051.625636:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637854336 00000100:00100000:3.0:1788212051.625737:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788212051.625750:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+14:17403:x1875075637854336:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1788212051.626225:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+15:17403:x1875075637854336:12345-192.168.204.29@tcp:35:bash.0 Request processed in 477us (708us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788212051.626235:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1788212051.717911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.719066:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637854592 00000100:00100000:0.0:1788212051.719080:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637854592 00000100:00100000:0.0:1788212051.719163:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1788212051.719211:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+15:17413:x1875075637854592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.719240:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.719262:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a71d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e94 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.719512:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788212051.719678:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a71d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e94 expref: 17 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.719696:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abfdb434800) 00010000:00010000:0.0:1788212051.719699:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788212051.719706:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a71d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e94 expref: 17 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.719735:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd800, rc 0) 00000100:00100000:0.0:1788212051.719831:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+16:17413:x1875075637854592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 623us (1937us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788212051.719839:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1788212051.724247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212051.725101:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637854848 00000100:00100000:1.0:1788212051.725116:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637854848 00000100:00100000:1.0:1788212051.725229:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788212051.725243:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+16:17413:x1875075637854848:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1788212051.726336:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+17:17413:x1875075637854848:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1087us (2092us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788212051.726348:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788212051.762225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212051.762314:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637855104 00000100:00100000:0.0:1788212051.762325:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637855104 00000100:00100000:0.0:1788212051.762386:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1788212051.762396:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+17:17416:x1875075637855104:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1788212051.762419:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212051.762439:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a71e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5e9b expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.762543:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a71ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.762559:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a71ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.762592:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a71ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212051.762608:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788212051.762804:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a71e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e9b expref: 20 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.762826:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a71ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e9b expref: 19 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212051.762835:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788212051.762837:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788212051.762841:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd600, rc 0) 00000100:00100000:0.0:1788212051.762927:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+19:17416:x1875075637855104:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 531us (714us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788212051.762935:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1788212051.769527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.769626:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637855232 00000100:00100000:2.0:1788212051.769636:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637855232 00000100:00100000:2.0:1788212051.769697:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:2.0:1788212051.769725:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+19:17416:x1875075637855232:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:2.0:1788212051.769793:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769810:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769822:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769850:0:18979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769857:0:18979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769891:0:18979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769897:0:18979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212051.769902:0:18979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769909:0:18979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769922:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:2.0:1788212051.769925:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788212051.769930:0:18979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212051.769936:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a71fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212051.770026:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec665c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+19:17416:x1875075637855232:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 318us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212051.770034:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:1.0:1788212051.772521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212051.772643:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637855616 00000100:00100000:3.0:1788212051.772653:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637855616 00000100:00100000:3.0:1788212051.772727:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1788212051.772754:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+19:17416:x1875075637855616:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1788212051.773396:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+20:17416:x1875075637855616:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 641us (882us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788212051.773405:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1788212051.779353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212051.785542:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637855360 00000100:00100000:2.0:1788212051.785566:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637855360 00000100:00100000:3.0:1788212051.786069:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788212051.786083:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac19d59b-b018-4eda-9f21-935367606cee+20:2358:x1875075637855360:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788212051.786099:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212051.786128:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd600/0x2afbce82f55a71ee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e9b expref: 20 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212051.786573:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212051.786580:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788212051.789611:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac19d59b-b018-4eda-9f21-935367606cee+19:2358:x1875075637855360:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 3516us (10255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212051.789634:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1788212052.058380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212052.058555:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637855872 00000100:00100000:2.0:1788212052.058566:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637855872 00000100:00080000:0.0:1788212052.058641:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212052.058646:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:2.0:1788212052.058669:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+19:17447:x1875075637855872:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1788212052.058698:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212052.058735:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a7203 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ea2 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.058879:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a720a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.058894:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a720a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.058905:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a720a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788212052.058917:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788212052.059084:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a7203 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ea2 expref: 22 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.059106:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a720a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ea2 expref: 21 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.059114:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:2.0:1788212052.059117:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788212052.059122:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81a00, rc 0) 00000100:00100000:2.0:1788212052.059241:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+21:17447:x1875075637855872:12345-192.168.204.29@tcp:101:cat.0 Request processed in 576us (871us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788212052.059249:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1788212052.075651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212052.075722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.075851:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637856128 00000100:00100000:3.0:1788212052.075862:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637856128 00000100:00100000:0.0:1788212052.075904:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637856256 00000100:00100000:0.0:1788212052.075910:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637856256 00000100:00100000:3.0:1788212052.075933:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1788212052.075947:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+22:17447:x1875075637856128:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1788212052.075977:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1788212052.075989:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac19d59b-b018-4eda-9f21-935367606cee+22:2358:x1875075637856256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788212052.076003:0:18965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788212052.076026:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a720a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ea2 expref: 22 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.076060:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788212052.076065:0:18965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788212052.076133:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac19d59b-b018-4eda-9f21-935367606cee+22:2358:x1875075637856256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 147us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212052.076141:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1788212052.076270:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac19d59b-b018-4eda-9f21-935367606cee+21:17447:x1875075637856128:12345-192.168.204.29@tcp:35:cat.0 Request processed in 327us (630us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788212052.076277:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000040:00080000:3.0:1788212052.133932:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788212052.158249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212052.158317:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637856512 00000100:00100000:0.0:1788212052.158328:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637856512 00000100:00100000:0.0:1788212052.158390:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1788212052.158401:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+21:17453:x1875075637856512:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1788212052.158429:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212052.158450:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a7218 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ea9 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.158554:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.158568:0:18980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.158576:0:18980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 22 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.158585:0:18980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.158624:0:18980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 22 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.159140:0:18980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 22 pid: 18980 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212052.159156:0:18980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001234380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18980:1875075660914816:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788212052.163570:0:18980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.163594:0:18980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212052.163612:0:18980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18980:1875075660914944:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788212052.163643:0:18980:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788212052.174505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212052.174550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.175053:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637856640 00000100:00100000:3.0:1788212052.175067:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637856640 00010000:00010000:3.0:1788212052.175119:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 23 pid: 18980 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212052.175221:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637856768 00000100:00100000:3.0:1788212052.175225:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637856768 00010000:00010000:3.0:1788212052.175242:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 24 pid: 18981 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212052.175272:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788212052.175283:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc41f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+24:2358:x1875075637856640:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788212052.175297:0:21105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212052.175310:0:21105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 24 pid: 18980 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175325:0:21105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 24 pid: 18980 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175355:0:21105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212052.175360:0:21105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175371:0:21105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.175376:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b06200/0x2afbce82f55a71d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e8d expref: 24 pid: 18980 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175380:0:21105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788212052.175402:0:18980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001234380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18980:1875075660914816:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788212052.175419:0:18980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18980:1875075660914944:192.168.204.29@tcp:104: 00010000:00010000:0.0:1788212052.175452:0:18980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212052.175457:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc41f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+23:2358:x1875075637856640:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 174us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.175470:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788212052.175533:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1788212052.175540:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+22:2358:x1875075637856768:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788212052.175554:0:21105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212052.175559:0:21105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175568:0:21105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175582:0:21105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8ccc00/0x2afbce82f55a71bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5e86 expref: 22 pid: 18981 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175593:0:21105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212052.175597:0:21105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175606:0:21105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175613:0:21105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175636:0:21105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788212052.175654:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+21:2358:x1875075637856768:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 115us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.175660:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:3.0:1788212052.175677:0:18980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.175683:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788212052.175723:0:18980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788212052.176418:0:18980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd800/0x2afbce82f55a7218 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ea9 expref: 22 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.176436:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd200/0x2afbce82f55a721f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ea9 expref: 21 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.176445:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212052.176447:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788212052.176450:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cd200, rc 0) 00000100:00100000:3.0:1788212052.176480:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+21:17453:x1875075637856512:12345-192.168.204.29@tcp:101:dd.0 Request processed in 18081us (18244us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788212052.176488:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:1.0:1788212052.183404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.183618:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857024 00000100:00100000:3.0:1788212052.183628:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857024 00000100:00100000:3.0:1788212052.183696:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:3.0:1788212052.185989:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+21:17453:x1875075637857024:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:3.0:1788212052.186376:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.186401:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.186415:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788212052.186475:0:18979:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788212052.187926:0:18979:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000000c1610 reply state 00000000c8d3867a transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212052.187942:0:18979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788212052.188133:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+24:17453:x1875075637857024:12345-192.168.204.29@tcp:36:dd.0 Request processed in 4423us (4736us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788212052.188143:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000020:00080000:3.0:1788212052.188150:0:18979:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788212052.191913:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.191931:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.193091:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.193098:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db1200 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212052.193104:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.193114:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.193139:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788212052.193143:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212052.193150:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.193157:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1200/0x2afbce82f55a722d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212052.195731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.196290:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857152 00000100:00100000:3.0:1788212052.196305:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857152 00000100:00100000:3.0:1788212052.196436:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:3.0:1788212052.196450:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+23:17453:x1875075637857152:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:3.0:1788212052.196481:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788212052.196505:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a7234 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5eb0 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.196615:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a7234 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb0 expref: 24 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.196631:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a7234 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb0 expref: 24 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.196668:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212052.196672:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788212052.196676:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec7db1400, rc 0) 00000100:00100000:3.0:1788212052.196767:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+24:17453:x1875075637857152:12345-192.168.204.29@tcp:101:dd.0 Request processed in 319us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.196774:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1788212052.197666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660915456:0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.197800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212052.197850:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788212052.197860:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660915072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788212052.197892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212052.197931:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abffde66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660915584:0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.197964:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212052.198011:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915456 00000100:00100000:2.0:1788212052.198020:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915456 00000100:00100000:2.0:1788212052.198717:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788212052.198743:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660915456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.198821:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660915456:12345-0@lo:400:kworker.0 Request processed in 83us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212052.198831:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788212052.198858:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788212052.198884:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915072 00000100:00100000:2.0:1788212052.198890:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915072 00000100:00100000:2.0:1788212052.198930:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788212052.198939:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660915072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788212052.198976:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788212052.199022:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875075660915072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212052.199030:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788212052.199110:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660915072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788212052.199129:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875075660915456:0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.199193:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915584 00000100:00100000:2.0:1788212052.199197:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915584 00000100:00100000:2.0:1788212052.199318:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788212052.199329:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660915584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.199382:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875075660915584:12345-0@lo:400:kworker.0 Request processed in 56us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212052.199408:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788212052.199450:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abffde66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875075660915584:0@lo:400:kworker.0 00000100:00100000:0.0:1788212052.201542:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660915200:0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.201602:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660915328:0@lo:400:kworker.0 00000100:00100000:0.0:1788212052.201631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212052.201651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788212052.201882:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660915712:0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.202518:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfef635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660915840:0@lo:400:kworker.0 00000100:00100000:0.0:1788212052.202530:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788212052.202555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212052.203935:0:18973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915200 00000100:00100000:1.0:1788212052.203949:0:18973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915200 00000100:00100000:2.0:1788212052.203959:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915712 00000100:00100000:2.0:1788212052.203967:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915712 00000100:00080000:2.0:1788212052.203993:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788212052.204008:0:18973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788212052.204024:0:18973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3310:x1875075660915200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788212052.204029:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915840 00000100:00100000:2.0:1788212052.204034:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915840 00000100:00100000:3.0:1788212052.204091:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788212052.204123:0:18973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9c126b8-6169-4174-8e0e-db6a3254d2db+19:3310:x1875075660915200:12345-0@lo:400:kworker.0 Request processed in 103us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.204127:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660915328 00000100:00100000:1.0:1788212052.204132:0:18973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788212052.204133:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660915328 00000100:00100000:3.0:1788212052.204200:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788212052.204221:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212052.204282:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875075660915328:12345-0@lo:400:kworker.0 Request processed in 62us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.204289:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788212052.204358:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875075660915328:0@lo:400:kworker.0 00000100:00100000:1.0:1788212052.204359:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9c126b8-6169-4174-8e0e-db6a3254d2db:3310:1875075660915200:0@lo:400:kworker.0 00000100:00100000:1.0:1788212052.204420:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660915712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212052.204451:0:18979:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788212052.204464:0:18979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788212052.204473:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875075660915712:12345-0@lo:400:kworker.0 Request processed in 371us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212052.204482:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788212052.204638:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788212052.204661:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660915840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788212052.204705:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875075660915840:12345-0@lo:400:kworker.0 Request processed in 58us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.204722:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788212052.204742:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875075660915712:0@lo:400:kworker.0 00000100:00100000:3.0:1788212052.204762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfef635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875075660915840:0@lo:400:kworker.0 00000100:00080000:2.0:1788212052.204802:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788212052.204807:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788212052.219328:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.219772:0:21105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857408 00000100:00100000:3.0:1788212052.219788:0:21105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857408 00000100:00100000:3.0:1788212052.219896:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788212052.219910:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+24:17453:x1875075637857408:12345-192.168.204.29@tcp:103:dd.0 00010000:00010000:3.0:1788212052.219930:0:21105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212052.219961:0:21105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a7234 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb0 expref: 24 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212052.219985:0:21105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:3.0:1788212052.220012:0:21105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788212052.220107:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+23:17453:x1875075637857408:12345-192.168.204.29@tcp:103:dd.0 Request processed in 199us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212052.220130:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788212052.224315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212052.224422:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857536 00000100:00100000:0.0:1788212052.224436:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857536 00000100:00100000:0.0:1788212052.224516:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1788212052.224529:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+23:17453:x1875075637857536:12345-192.168.204.29@tcp:58:dd.0 00010000:00010000:0.0:1788212052.224770:0:18980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.224822:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212052.224980:0:18980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788212052.227499:0:18980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788212052.227684:0:18980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788212052.227785:0:18980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788212052.228081:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+23:17453:x1875075637857536:12345-192.168.204.29@tcp:58:dd.0 Request processed in 3546us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212052.228094:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:1.0:1788212052.231833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212052.232007:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857664 00000100:00100000:3.0:1788212052.232021:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857664 00000100:00100000:2.0:1788212052.232449:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:2.0:1788212052.232464:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+23:17453:x1875075637857664:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1788212052.232491:0:18979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212052.232516:0:18979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5eb7 expref: -99 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232600:0:18979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232612:0:18979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 24 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232633:0:18979:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232665:0:18979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 24 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232680:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:2.0:1788212052.232684:0:18979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788212052.232688:0:18979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 24 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212052.232695:0:18979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80000, rc 0) 00000100:00100000:2.0:1788212052.232775:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+24:17453:x1875075637857664:12345-192.168.204.29@tcp:101:dd.0 Request processed in 315us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212052.232784:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00010000:00010000:1.0:1788212052.645468:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788212052.781789:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901900 is committed 00000001:00080000:2.0:1788212052.781812:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901891 is committed 00000001:00080000:2.0:1788212052.781838:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:2.0:1788212052.781847:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901902 is committed 00000001:00080000:2.0:1788212052.781852:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901906 is committed 00000001:00080000:2.0:1788212052.781884:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000040:00080000:3.0:1788212053.158596:0:19011:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788212053.158610:0:19011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788212053.158654:0:19011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788212053.158661:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788212053.158815:0:19011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19011:1875075660915968:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788212053.158948:0:19011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68840 going to sleep for 11 seconds 00000100:00100000:3.0:1788212053.171540:0:19011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001202300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19011:1875075660915968:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788212053.180930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.181227:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857792 00000100:00100000:0.0:1788212053.181239:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857792 00000100:00100000:0.0:1788212053.181308:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1788212053.181317:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637857792:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788212053.181403:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637857792:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 Request processed in 87us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212053.181410:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788212053.183887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.184538:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637857920 00000100:00100000:3.0:1788212053.184549:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637857920 00000100:00100000:3.0:1788212053.184619:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788212053.184633:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637857920:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788212053.184698:0:18981:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788212053.184847:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637857920:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 217us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212053.184854:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1788212053.190766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.202438:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637858048 00000100:00100000:0.0:1788212053.202457:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637858048 00000100:00100000:0.0:1788212053.202614:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:0.0:1788212053.202628:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637858048:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788212053.202748:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202765:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202780:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202798:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202832:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202839:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202869:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202879:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202885:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788212053.202926:0:21121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788212053.202930:0:21121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788212053.202943:0:21121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202954:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202960:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202967:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202973:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.202978:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.202995:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203010:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434c00) 00010000:00010000:0.0:1788212053.203013:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.203018:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203025:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a7249 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203042:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203047:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203053:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203059:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.203062:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203069:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203076:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8abfdb434f00) 00010000:00010000:0.0:1788212053.203079:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.203081:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203097:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7250 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203130:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203137:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203143:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203147:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cde00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.203150:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203155:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203163:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:0.0:1788212053.203208:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.203211:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.203216:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cde00/0x2afbce82f55a7257 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.204112:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637858048:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 1471us (13341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212053.204129:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:2.0:1788212053.217952:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.222318:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637858304 00000100:00100000:3.0:1788212053.222333:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637858304 00000100:00100000:2.0:1788212053.223810:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:2.0:1788212053.223826:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+11:17454:x1875075637858304:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.223849:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212053.223874:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a725e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ebe expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.223977:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224006:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224017:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788212053.224030:0:18981:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788212053.224205:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224214:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224222:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224228:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212053.224233:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224241:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224257:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:2.0:1788212053.224260:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788212053.224266:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224272:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a7265 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224470:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a725e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ebe expref: 13 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224489:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8abfdb434c00) 00010000:00010000:2.0:1788212053.224492:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788212053.224496:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a725e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ebe expref: 13 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.224507:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81600, rc 0) 00000100:00100000:2.0:1788212053.224582:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+12:17454:x1875075637858304:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 759us (6641us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788212053.224590:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:1.0:1788212053.228037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.228133:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637858432 00000100:00100000:2.0:1788212053.228144:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637858432 00000100:00100000:2.0:1788212053.228221:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1788212053.228234:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+12:17454:x1875075637858432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788212053.228266:0:18979:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788212053.228369:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+12:17454:x1875075637858432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.228376:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1788212053.233501:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.233624:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637858688 00000100:00100000:2.0:1788212053.233638:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637858688 00000100:00100000:2.0:1788212053.233725:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1788212053.233736:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+12:17454:x1875075637858688:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.233758:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212053.233783:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a7273 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ec5 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788212053.234732:0:18981:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =59 00000004:00080000:2.0:1788212053.234739:0:18981:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+59 in llog 00000004:00080000:2.0:1788212053.234789:0:18981:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788212053.235091:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a727a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.235111:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a727a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.235123:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a727a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.235219:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a7273 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ec5 expref: 15 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.235239:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a727a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ec5 expref: 14 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.235248:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206eb00) 00010000:00010000:2.0:1788212053.235251:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788212053.235254:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb80c00, rc 0) 00000100:00100000:2.0:1788212053.235342:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637858688:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1607us (1855us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788212053.235349:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1788212053.238757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.238919:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637858944 00000100:00100000:0.0:1788212053.238930:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637858944 00000100:00100000:0.0:1788212053.238990:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1788212053.239002:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637858944:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788212053.239067:0:21121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788212053.239100:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80c00/0x2afbce82f55a727a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ec5 expref: 14 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239134:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206eb00) 00010000:00010000:0.0:1788212053.239145:0:21121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788212053.239207:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239221:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239230:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239245:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239250:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239256:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239555:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239578:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239584:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239590:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.239594:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239602:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239612:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8abfdb434000) 00010000:00010000:0.0:1788212053.239615:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.239618:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239623:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc000/0x2afbce82f55a7288 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239633:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239640:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239645:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239650:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.239658:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239665:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239672:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc192d484 (ffff8abfdb434f00) 00010000:00010000:0.0:1788212053.239675:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.239677:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.239683:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a728f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc192d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.239770:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+13:17454:x1875075637858944:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 769us (1022us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788212053.239777:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1788212053.247873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.247958:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637859072 00000100:00100000:2.0:1788212053.247969:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637859072 00000100:00100000:2.0:1788212053.248037:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:2.0:1788212053.248048:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+13:17454:x1875075637859072:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.248086:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212053.248122:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a7296 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ecc expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248195:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a729d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248209:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a729d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248222:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a729d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248347:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a7296 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ecc expref: 15 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248366:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81000/0x2afbce82f55a729d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ecc expref: 14 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.248375:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:2.0:1788212053.248378:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788212053.248382:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81000, rc 0) 00000100:00100000:2.0:1788212053.248448:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637859072:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 402us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.248455:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:3.0:1788212053.251750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.251899:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637859328 00000100:00100000:0.0:1788212053.251909:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637859328 00000100:00100000:0.0:1788212053.251974:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:0.0:1788212053.251986:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637859328:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788212053.252071:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.252090:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.252101:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788212053.252709:0:21121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788212053.252721:0:21121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642558553552ns, next at 643558551367ns, rc = 0 00000004:00010000:0.0:1788212053.252816:0:21121:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009adbb7b8 reply state 000000006ecc2bcb transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.252827:0:21121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788212053.252935:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+16:17454:x1875075637859328:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 951us (1194us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788212053.252943:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00010000:00010000:2.0:1788212053.254234:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254248:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254268:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254273:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:2.0:1788212053.254277:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254295:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254311:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:2.0:1788212053.254314:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788212053.254318:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.254324:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72a4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212053.255220:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.255398:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637859456 00000100:00100000:2.0:1788212053.255409:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637859456 00000100:00100000:2.0:1788212053.255461:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:2.0:1788212053.255470:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+15:17454:x1875075637859456:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.255491:0:18980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212053.255507:0:18980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ed3 expref: -99 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.255566:0:18980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 16 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.255595:0:18980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 16 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.255613:0:18980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:2.0:1788212053.255615:0:18980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788212053.255618:0:18980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81600, rc 0) 00000100:00100000:2.0:1788212053.255695:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+16:17454:x1875075637859456:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 210us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.255702:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:3.0:1788212053.257821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.258922:0:19668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637859584 00000100:00100000:2.0:1788212053.258935:0:19668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637859584 00000100:00100000:2.0:1788212053.259015:0:19668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1788212053.259030:0:19668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac19d59b-b018-4eda-9f21-935367606cee+5:2358:x1875075637859584:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788212053.259398:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788212053.260577:0:19668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac19d59b-b018-4eda-9f21-935367606cee+6:2358:x1875075637859584:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 1543us (2759us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788212053.260591:0:19668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1788212053.263576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.263729:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637859840 00000100:00100000:3.0:1788212053.263740:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637859840 00000100:00100000:3.0:1788212053.263813:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788212053.263824:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+16:17454:x1875075637859840:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788212053.264119:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+17:17454:x1875075637859840:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 296us (554us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788212053.264128:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1788212053.271043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.271279:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860096 00000100:00100000:0.0:1788212053.271289:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860096 00000100:00100000:0.0:1788212053.271350:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:0.0:1788212053.271361:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+17:17454:x1875075637860096:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788212053.271480:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+17:17454:x1875075637860096:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212053.271488:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1788212053.275847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.276073:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860224 00000100:00100000:2.0:1788212053.276084:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860224 00000100:00100000:2.0:1788212053.276280:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:2.0:1788212053.276292:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+17:17454:x1875075637860224:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.276312:0:18981:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788212053.276334:0:18981:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a72b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5eda expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276424:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276444:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276456:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788212053.276492:0:18981:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788212053.276507:0:18981:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276533:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81a00/0x2afbce82f55a72b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eda expref: 19 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276550:0:18981:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eda expref: 18 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.276559:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:2.0:1788212053.276562:0:18981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788212053.276565:0:18981:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abffdb81800, rc 0) 00000100:00100000:2.0:1788212053.276625:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637860224:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 335us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.276632:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1788212053.278987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.279137:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860352 00000100:00100000:0.0:1788212053.279150:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860352 00000100:00100000:0.0:1788212053.279238:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1788212053.279248:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+6:2359:x1875075637860352:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788212053.279269:0:20100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788212053.279294:0:20100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8db5cc36922f5ee1 expref: -99 pid: 20100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788212053.279349:0:20100:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95f354, blocks: 0x1 00010000:00010000:0.0:1788212053.279375:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788212053.279379:0:20100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788212053.279388:0:20100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 7 pid: 20100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.279404:0:20100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 7 pid: 20100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.279416:0:20100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abfca8cc400, rc 0) 00000100:00100000:0.0:1788212053.279464:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+7:2359:x1875075637860352:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 218us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212053.279470:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788212053.282269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.282399:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860608 00000100:00100000:0.0:1788212053.282410:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860608 00000100:00100000:0.0:1788212053.282471:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:0.0:1788212053.282481:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637860608:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788212053.282601:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637860608:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 120us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212053.282608:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:3.0:1788212053.288977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.289063:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860736 00000100:00100000:2.0:1788212053.289075:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860736 00000100:00100000:2.0:1788212053.289153:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:2.0:1788212053.289195:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637860736:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788212053.332449:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:0.0:1788212053.332467:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788212053.332499:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000100:00100000:0.0:1788212053.332750:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788212053.332794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660916096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788212053.332887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212053.333124:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660916096 00000100:00100000:1.0:1788212053.333132:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660916096 00000100:00100000:1.0:1788212053.333219:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788212053.333231:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660916096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788212053.333425:0:19667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788212053.333429:0:19667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788212053.333432:0:19667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788212053.333434:0:19667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788212052 -> 1788212052 00002000:00010000:1.0:1788212053.333436:0:19667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788212053.333477:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875075660916096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (590us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788212053.333484:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788212053.333631:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac001365180/2, rc 0, transno 12884901891 00000100:00100000:0.0:1788212053.333637:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660916096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788212053.334561:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637860736:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 45390us (45587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.334583:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:3.0:1788212053.337446:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212053.337531:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637860864 00000100:00100000:1.0:1788212053.337541:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637860864 00000100:00100000:1.0:1788212053.337727:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1788212053.337752:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+7:2358:x1875075637860864:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788212053.337868:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+7:2358:x1875075637860864:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 117us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212053.337876:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1788212053.340255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.340338:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861120 00000100:00100000:3.0:1788212053.340348:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861120 00000100:00100000:3.0:1788212053.340415:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1788212053.340425:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637861120:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788212053.340483:0:18979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212053.340512:0:18979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81800/0x2afbce82f55a72b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eda expref: 14 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.340533:0:18979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:3.0:1788212053.340537:0:18979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788212053.340565:0:18979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.340596:0:18979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.340606:0:18979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788212053.340810:0:18979:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e159fad reply state 0000000065f814f9 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212053.340819:0:18979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788212053.340910:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac19d59b-b018-4eda-9f21-935367606cee+15:17454:x1875075637861120:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 486us (664us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788212053.340916:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00010000:00010000:0.0:1788212053.342903:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342926:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342935:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342942:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db1400 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:0.0:1788212053.342947:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342957:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342977:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:0.0:1788212053.342981:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788212053.342985:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.342991:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1400/0x2afbce82f55a72c7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.345223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.345300:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861248 00000100:00100000:3.0:1788212053.345311:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861248 00000100:00100000:3.0:1788212053.345376:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1788212053.345388:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+7:2359:x1875075637861248:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788212053.345604:0:19667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788212053.345609:0:19667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788212051 00002000:00010000:3.0:1788212053.345611:0:19667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788212051 00002000:00010000:3.0:1788212053.345614:0:19667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788212052 -> 1788212051 00002000:00010000:3.0:1788212053.345616:0:19667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788212053.345693:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac19d59b-b018-4eda-9f21-935367606cee+8:2359:x1875075637861248:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 298us (472us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788212053.345703:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1788212053.348773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.348860:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861376 00000100:00100000:2.0:1788212053.348870:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861376 00000100:00100000:2.0:1788212053.348926:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788212053.348937:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac19d59b-b018-4eda-9f21-935367606cee+8:2358:x1875075637861376:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788212053.348991:0:19665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349009:0:19665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.349013:0:19665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.349018:0:19665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349031:0:19665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349065:0:19665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349072:0:19665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349080:0:19665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349087:0:19665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb80c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212053.349099:0:19665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349120:0:19665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349134:0:19665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.349140:0:19665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a49987a9/0x2afbce82f55a72ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.349237:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac19d59b-b018-4eda-9f21-935367606cee+8:2358:x1875075637861376:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 301us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.349244:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1788212053.352233:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.352366:0:21121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861632 00000100:00100000:0.0:1788212053.352391:0:21121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861632 00000100:00100000:0.0:1788212053.352452:0:21121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:0.0:1788212053.352462:0:21121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+14:17454:x1875075637861632:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788212053.352545:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352561:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352571:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352814:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352827:0:21121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 15 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352835:0:21121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352881:0:21121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 15 pid: 18980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.352895:0:21121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 15 pid: 18980 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.352909:0:21121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfefac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21121:1875075660916224:192.168.204.29@tcp:104: 00000100:00100000:0.0:1788212053.353001:0:21121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abff65790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788212053.355996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1788212053.356093:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861760 00000100:00100000:2.0:1788212053.356113:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861760 00010000:00010000:2.0:1788212053.356159:0:18966:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 16 pid: 18980 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.356234:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1788212053.356245:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac19d59b-b018-4eda-9f21-935367606cee+16:2358:x1875075637861760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788212053.356264:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788212053.356271:0:18966:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 16 pid: 18980 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.356296:0:18966:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 16 pid: 18980 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.356317:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:2.0:1788212053.356322:0:18966:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.356331:0:18966:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.356338:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.356356:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788212053.356406:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac19d59b-b018-4eda-9f21-935367606cee+16:2358:x1875075637861760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.356414:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00010000:00010000:3.0:1788212053.356939:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb81600/0x2afbce82f55a72ab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ed3 expref: 15 pid: 18980 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212053.356965:0:21121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfefac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21121:1875075660916224:192.168.204.29@tcp:104: 00010000:00010000:3.0:1788212053.356985:0:21121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.356994:0:21121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.356999:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788212053.357239:0:21121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788212053.357372:0:21121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788212053.357413:0:21121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788212053.357480:0:21121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfc9f35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21121:1875075660916352:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788212053.357531:0:21121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212053.357561:0:21121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68840 going to sleep for 11 seconds 00000100:00100000:2.0:1788212053.357750:0:18984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660916352 00000100:00100000:2.0:1788212053.357757:0:18984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660916352 00000100:00100000:2.0:1788212053.357794:0:18984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788212053.357803:0:18984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21121:x1875075660916352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788212053.357891:0:18984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21121:x1875075660916352:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788212053.357899:0:18984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788212053.358637:0:21121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfc9f35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21121:1875075660916352:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788212053.359390:0:21121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788212053.359467:0:21121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8abfc9f35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21121:1875075660916480:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788212053.359525:0:21121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788212053.359549:0:21121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfcaf68000 going to sleep for 11 seconds 00000100:00100000:2.0:1788212053.359729:0:18984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660916480 00000100:00100000:2.0:1788212053.359736:0:18984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660916480 00000100:00100000:2.0:1788212053.359774:0:18984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788212053.359784:0:18984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfc9f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21121:x1875075660916480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788212053.359966:0:18984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfc9f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21121:x1875075660916480:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (441us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788212053.359975:0:18984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788212053.360048:0:21121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8abfc9f35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21121:1875075660916480:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788212053.360081:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360090:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360097:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360103:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc600 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212053.360107:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360114:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360128:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:1.0:1788212053.360131:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788212053.360135:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360140:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc600/0x2afbce82f55a72dc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360203:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360216:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360221:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360226:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd000 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212053.360229:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360234:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360241:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788212053.360244:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788212053.360249:0:21121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 18 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360259:0:21121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 18 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360268:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 18 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.360319:0:21121:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abffdb80000/0x2afbce82f55a7242 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5eb7 expref: 18 pid: 18979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.360330:0:21121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21121:1875075660916608:192.168.204.29@tcp:105: 00000100:00100000:1.0:1788212053.360398:0:21121:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788212053.365122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212053.365298:0:21121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21121:1875075660916608:192.168.204.29@tcp:105: 00010000:00010000:1.0:1788212053.365326:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365336:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cd000/0x2afbce82f55a723b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365365:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365380:0:21121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365390:0:21121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365402:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365408:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365415:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365421:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07e00 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212053.365425:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365432:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365462:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788212053.365465:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788212053.365469:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365485:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfd2b07e00/0x2afbce82f55a72e3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365496:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365501:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365506:0:21121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365511:0:21121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cc800 already unused, calling callback (ffffffffc21594f0) 00010000:00010000:1.0:1788212053.365514:0:21121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365520:0:21121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365527:0:21121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8abfdb434700) 00010000:00010000:1.0:1788212053.365529:0:21121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788212053.365532:0:21121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.365538:0:21121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abfca8cc800/0x2afbce82f55a72d5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.365791:0:21121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637861632:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 13329us (13564us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788212053.365802:0:21121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000020:00080000:1.0:1788212053.365809:0:21121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788212053.366063:0:19011:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788212053.366071:0:19011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788212053.366100:0:19011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788212053.366105:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788212053.366401:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637861888 00000100:00100000:3.0:1788212053.366409:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637861888 00000100:00100000:3.0:1788212053.366459:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1788212053.366478:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfd0b1a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+18:17453:x1875075637861888:12345-192.168.204.29@tcp:49:dd.0 00000100:00100000:3.0:1788212053.366582:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfd0b1a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+18:17453:x1875075637861888:12345-192.168.204.29@tcp:49:dd.0 Request processed in 115us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212053.366598:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1788212053.374672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.374888:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862144 00000100:00100000:3.0:1788212053.374900:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862144 00000100:00100000:3.0:1788212053.375016:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1788212053.375028:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+18:17454:x1875075637862144:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788212053.378801:0:18983:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788212053.379577:0:18983:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788212053.379665:0:18983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379698:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379712:0:18983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379723:0:18983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379730:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379737:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.379770:0:18983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788212053.380036:0:18968:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788212053.380044:0:18968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.380052:0:18968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db1800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212053.380056:0:18968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.380065:0:18968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.380078:0:18968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ac00206e000) 00010000:00010000:0.0:1788212053.380081:0:18968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788212053.380086:0:18968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.380092:0:18968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec7db1800/0x2afbce82f55a72ea lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.380118:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212053.380121:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788212053.380122:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788212053.381092:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfef634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac19d59b-b018-4eda-9f21-935367606cee+20:17454:x1875075637862144:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 6057us (6420us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788212053.381113:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000020:00080000:3.0:1788212053.381132:0:18983:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788212053.397535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.397582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212053.397695:0:19672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862400 00000100:00100000:1.0:1788212053.397704:0:19672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862400 00000100:00100000:1.0:1788212053.397769:0:19672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862272 00000100:00100000:1.0:1788212053.397772:0:19672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862272 00000100:00100000:1.0:1788212053.397792:0:19672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1788212053.397804:0:19672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac19d59b-b018-4eda-9f21-935367606cee+9:2359:x1875075637862400:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1788212053.397844:0:19672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.397875:0:19672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 9 pid: 20100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.397884:0:19672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.397889:0:19672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.397893:0:19672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.397934:0:19672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 9 pid: 20100 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.397950:0:19672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 9 pid: 20100 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.397993:0:19672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:19672:1875075660916736:192.168.204.29@tcp:104: 00000100:00100000:1.0:1788212053.398098:0:19672:0:(client.c:2715:ptlrpc_set_wait()) set ffff8abfca5d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788212053.401759:0:19672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:19672:1875075660916736:192.168.204.29@tcp:104: 00010000:00010000:1.0:1788212053.401806:0:19672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.402938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.402981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.403013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.403047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.403115:0:21105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862656 00000100:00100000:3.0:1788212053.403125:0:21105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862656 00010000:00010000:3.0:1788212053.403215:0:21105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 10 pid: 20100 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788212053.403256:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1788212053.403267:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+10:2358:x1875075637862656:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788212053.403284:0:21105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788212053.403314:0:21105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 10 pid: 20100 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403329:0:21105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 10 pid: 20100 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403356:0:21105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc854322/0x2afbce82f55a72c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0x8db5cc36922f5ee1 expref: 10 pid: 20100 timeout: 742 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403378:0:21105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212053.403384:0:21105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212053.403393:0:21105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403404:0:21105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403435:0:21105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788212053.403501:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac19d59b-b018-4eda-9f21-935367606cee+9:2358:x1875075637862656:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 236us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788212053.403509:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:3.0:1788212053.403534:0:19672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.403543:0:19672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.404548:0:19673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788212053.404563:0:19673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788212053.404658:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788212053.404674:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862784 00000100:00100000:2.0:1788212053.404682:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862784 00000100:00100000:2.0:1788212053.404734:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788212053.404740:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862528 00000100:00100000:2.0:1788212053.404743:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862528 00000100:00100000:2.0:1788212053.404754:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788212053.404759:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637862912 00000100:00100000:2.0:1788212053.404762:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637862912 00000100:00100000:0.0:1788212053.406970:0:21125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1788212053.406998:0:21125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac19d59b-b018-4eda-9f21-935367606cee+12:2359:x1875075637862272:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:0.0:1788212053.407081:0:21125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.407650:0:21125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788212053.407658:0:21125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788212053.407667:0:21125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.407698:0:21125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.410413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1788212053.410491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.412877:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788212053.415118:0:19673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788212053.417013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1788212053.417385:0:19671:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788212053.417595:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863168 00000100:00100000:3.0:1788212053.417607:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863168 00000100:00100000:3.0:1788212053.417671:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788212053.417678:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863040 00000100:00100000:3.0:1788212053.417681:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863040 00000100:00100000:3.0:1788212053.418110:0:21126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1788212053.418122:0:21126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac19d59b-b018-4eda-9f21-935367606cee+15:2358:x1875075637862784:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1788212053.418158:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.418216:0:21126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212053.418221:0:21126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788212053.418227:0:21126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788212053.418241:0:21126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.421382:0:19673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788212053.422367:0:19671:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788212053.422384:0:19671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863296 00000100:00100000:1.0:1788212053.422396:0:19671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863296 00000100:00100000:0.0:1788212053.426356:0:21127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1788212053.426511:0:21127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac19d59b-b018-4eda-9f21-935367606cee+17:2358:x1875075637862528:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1788212053.426569:0:21127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.426595:0:21127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.426601:0:21127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.426611:0:21127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.426629:0:21127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788212053.496411:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788212053.496431:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901891 is committed 00000001:00080000:1.0:1788212053.496444:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00002000:00010000:0.0:1788212053.496563:0:21125:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1788212053.496568:0:21125:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788212051 -> 1788212052 00002000:00010000:0.0:1788212053.496571:0:21125:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788212051 -> 1788212052 00002000:00010000:0.0:1788212053.496573:0:21125:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1788212053.496592:0:21125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496606:0:21125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496616:0:21125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496645:0:21125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd400 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212053.496649:0:21125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496658:0:21125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496680:0:21125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496702:0:21125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5db44f/0x2afbce82f55a72f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.496802:0:21125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac19d59b-b018-4eda-9f21-935367606cee+19:2359:x1875075637862272:12345-192.168.204.29@tcp:4:dd.0 Request processed in 89809us (99213us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788212053.496817:0:21125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1788212053.496854:0:21125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1788212053.496865:0:21125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac19d59b-b018-4eda-9f21-935367606cee+18:2358:x1875075637862912:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:0.0:1788212053.496896:0:21125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496909:0:21125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788212053.496913:0:21125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788212053.496920:0:21125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.496958:0:21125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788212053.499909:0:19672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1788212053.499938:0:19672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.499952:0:19672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.499963:0:19672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.499972:0:19672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b07e00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212053.499978:0:19672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.500003:0:19672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.500027:0:19672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.500034:0:19672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077f5970e/0x2afbce82f55a72f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.500137:0:19672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac19d59b-b018-4eda-9f21-935367606cee+18:2359:x1875075637862400:12345-192.168.204.29@tcp:4:dd.0 Request processed in 102330us (102609us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788212053.500147:0:19672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1788212053.500235:0:19672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1788212053.500249:0:19672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac19d59b-b018-4eda-9f21-935367606cee+17:2359:x1875075637863168:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1788212053.500288:0:19672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.500300:0:19672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.500305:0:19672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.500311:0:19672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.500324:0:19672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788212053.551821:0:21126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 4194304 -> 7340032 00010000:00010000:1.0:1788212053.551846:0:21126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551862:0:21126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551872:0:21126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551880:0:21126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec7db1000 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212053.551885:0:21126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551893:0:21126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551914:0:21126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.551923:0:21126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000563b0f89/0x2afbce82f55a72ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.552039:0:21126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac19d59b-b018-4eda-9f21-935367606cee+21:2358:x1875075637862784:12345-192.168.204.29@tcp:4:dd.0 Request processed in 133915us (149053us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788212053.552049:0:21126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:1.0:1788212053.552079:0:21126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1788212053.552091:0:21126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac19d59b-b018-4eda-9f21-935367606cee+20:2359:x1875075637863040:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1788212053.552132:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.552144:0:21126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.552149:0:21126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788212053.552154:0:21126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.552199:0:21126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788212053.552320:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00010000:00010000:2.0:1788212053.552405:0:21127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552414:0:21127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552422:0:21127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552428:0:21127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06c00 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212053.552431:0:21127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552438:0:21127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552449:0:21127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552456:0:21127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11730f4/0x2afbce82f55a7306 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.552488:0:21127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac19d59b-b018-4eda-9f21-935367606cee+16:2358:x1875075637862528:12345-192.168.204.29@tcp:4:dd.0 Request processed in 126116us (149472us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788212053.552495:0:21127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1788212053.552518:0:21127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1788212053.552526:0:21127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac19d59b-b018-4eda-9f21-935367606cee+15:2359:x1875075637863296:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1788212053.552542:0:21127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552550:0:21127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.552553:0:21127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788212053.552558:0:21127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.552567:0:21127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788212053.617481:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00000001:00080000:1.0:1788212053.617517:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00002000:00010000:0.0:1788212053.617608:0:21125:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788212053.617613:0:21125:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788212053.617631:0:21125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617643:0:21125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617653:0:21125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617661:0:21125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfca8cd600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:0.0:1788212053.617665:0:21125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617673:0:21125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617706:0:21125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788212053.617714:0:21125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4b7b55/0x2afbce82f55a730d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788212053.617843:0:21125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac19d59b-b018-4eda-9f21-935367606cee+15:2358:x1875075637862912:12345-192.168.204.29@tcp:4:dd.0 Request processed in 120973us (214787us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788212053.617857:0:21125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:2.0:1788212053.618347:0:19672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618359:0:19672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618368:0:19672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618375:0:19672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81800 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212053.618378:0:19672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618386:0:19672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618408:0:19672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.618416:0:19672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a306af06/0x2afbce82f55a7314 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.618462:0:19672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac19d59b-b018-4eda-9f21-935367606cee+13:2359:x1875075637863168:12345-192.168.204.29@tcp:4:dd.0 Request processed in 118218us (208060us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788212053.618471:0:19672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000001:00080000:3.0:1788212053.659645:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00000001:00080000:3.0:1788212053.659661:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:2.0:1788212053.660011:0:21127:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1788212053.660030:0:21127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660042:0:21127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660051:0:21127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660058:0:21127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abffdb81600 already unused, calling callback (ffffffffc171a230) 00010000:00010000:2.0:1788212053.660062:0:21127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660070:0:21127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660247:0:21127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788212053.660258:0:21127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa4de7b7/0x2afbce82f55a7322 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788212053.660359:0:21127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ac19d59b-b018-4eda-9f21-935367606cee+7:2359:x1875075637863296:12345-192.168.204.29@tcp:4:dd.0 Request processed in 107829us (243356us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788212053.660369:0:21127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00010000:00010000:1.0:1788212053.661968:0:21126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.661984:0:21126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.662012:0:21126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.662020:0:21126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abfd2b06200 already unused, calling callback (ffffffffc171a230) 00010000:00010000:1.0:1788212053.662025:0:21126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.662035:0:21126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.662054:0:21126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788212053.662061:0:21126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2be29b2/0x2afbce82f55a731b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788212053.662227:0:21126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ac19d59b-b018-4eda-9f21-935367606cee+5:2359:x1875075637863040:12345-192.168.204.29@tcp:4:dd.0 Request processed in 110136us (251731us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788212053.662236:0:21126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00010000:00010000:1.0:1788212053.669438:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788212054.693390:0:20634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788212054.757586:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660916864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788212054.757695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788212054.757860:0:19669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075660916864 00000100:00100000:1.0:1788212054.757869:0:19669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075660916864 00000100:00100000:1.0:1788212054.757950:0:19669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788212054.757964:0:19669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660916864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788212054.758030:0:19669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00080000:0.0:1788212054.758237:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788212054.758312:0:19669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abfefac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875075660916864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 351us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212054.758320:0:19669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788212054.758415:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ac001364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875075660916864:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788212055.400654:0:19011:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788212055.400664:0:19011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788212055.400699:0:19011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788212055.400707:0:19011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:0.0:1788212055.448084:0:21165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788212055.717425:0:18968:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788212055.768975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1788212055.769199:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863680 00000100:00100000:1.0:1788212055.769208:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863680 00000100:00100000:1.0:1788212055.769256:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637864192 00000100:00100000:1.0:1788212055.769260:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637864192 00000100:00100000:1.0:1788212055.769274:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863808 00000100:00100000:1.0:1788212055.769277:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863808 00000100:00100000:1.0:1788212055.769293:0:20100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637864064 00000100:00100000:1.0:1788212055.769296:0:20100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637864064 00000100:00100000:1.0:1788212055.769312:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1788212055.769321:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2359:x1875075637863680:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212055.769387:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2359:x1875075637863680:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212055.769394:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1788212055.769412:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788212055.769418:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2359:x1875075637864192:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212055.769443:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2359:x1875075637864192:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212055.769463:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1788212055.769476:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788212055.769482:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2359:x1875075637863808:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212055.769506:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac19d59b-b018-4eda-9f21-935367606cee+5:2359:x1875075637863808:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212055.769511:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1788212055.769522:0:20100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1788212055.769528:0:20100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2359:x1875075637864064:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1788212055.769550:0:20100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532a896b-a4e1-4980-8fe1-6a69ed7a7120+5:2359:x1875075637864064:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788212055.769555:0:20100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00080000:1.0:1788212055.769572:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788212055.769576:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788212055.769706:0:18971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863424 00000100:00100000:0.0:1788212055.769712:0:18971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863424 00000100:00100000:0.0:1788212055.769749:0:18971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788212055.769756:0:18971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8abffe053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2359:x1875075637863424:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212055.769782:0:18971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8abffe053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54d0ecf5-5943-42bf-82b5-6e0157b29789+13:2359:x1875075637863424:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212055.769788:0:18971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1788212055.769817:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863936 00000100:00100000:0.0:1788212055.769820:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863936 00000100:00100000:0.0:1788212055.769851:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875075637863552 00000100:00100000:0.0:1788212055.769854:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875075637863552 00000100:00100000:0.0:1788212055.769873:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1788212055.769879:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2359:x1875075637863936:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212055.769909:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532a896b-a4e1-4980-8fe1-6a69ed7a7120+6:2359:x1875075637863936:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212055.769915:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1788212055.769936:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1788212055.769946:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+20:2359:x1875075637863552:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1788212055.769976:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac001364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac19d59b-b018-4eda-9f21-935367606cee+20:2359:x1875075637863552:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788212055.769982:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00080000:0.0:1788212055.769996:0:18975:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788212056.748882:0:18967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9871 lines, 9871 kept, 0 dropped, 0 bad.