00000100:00100000:2.0F:1788940658.156704:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738302976:0@lo:400:kworker.0 00000100:00100000:1.0F:1788940658.156719:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738303104:0@lo:400:kworker.0 00000100:00100000:3.0F:1788940658.156868:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738303232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940658.156978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940658.157036:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738303488:0@lo:400:kworker.0 00000100:00100000:2.0:1788940658.157063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940658.157098:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303488 00000100:00100000:2.0:1788940658.157106:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303488 00000100:00100000:2.0:1788940658.157164:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940658.157174:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.167050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940658.167127:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940658.167172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940658.167196:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940658.167203:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738303360:0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.167228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940658.167378:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738302976 00000100:00100000:3.0:1788940658.167396:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738302976 00000100:00100000:3.0:1788940658.167442:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788940658.167452:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738302976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.167503:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738302976:12345-0@lo:400:kworker.0 Request processed in 53us (10526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.167511:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788940658.167563:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940658.167576:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303360 00000100:00100000:3.0:1788940658.167580:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303360 00000100:00100000:3.0:1788940658.167610:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940658.167617:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738303360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.167650:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738303360:12345-0@lo:400:kworker.0 Request processed in 34us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.167656:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940658.167676:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303232 00000100:00100000:3.0:1788940658.167679:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303232 00000100:00100000:3.0:1788940658.167711:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940658.167717:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738303232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.167751:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738303232:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.167771:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940658.167833:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738303872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940658.167864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940658.167909:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303744 00000100:00100000:3.0:1788940658.167914:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303744 00000100:00100000:3.0:1788940658.167937:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303872 00000100:00100000:3.0:1788940658.167940:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303872 00000100:00100000:3.0:1788940658.167956:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940658.167963:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738303744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940658.167992:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940658.168023:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738303744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.168030:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940658.168042:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940658.168048:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738303872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940658.168068:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940658.168096:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738303872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.168102:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788940658.168120:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940658.168122:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940658.168501:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738303872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940658.168558:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738303360:0@lo:400:kworker.0 00000100:00100000:3.0:1788940658.168574:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940658.168581:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738303488:12345-0@lo:400:kworker.0 Request processed in 11408us (11515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.168584:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738303232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940658.168589:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940658.170612:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738303488:0@lo:400:kworker.0 00000100:00100000:2.0:1788940658.170630:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738302976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940658.179826:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940658.179909:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303104 00000100:00100000:1.0:1788940658.179918:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303104 00000100:00100000:1.0:1788940658.179970:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940658.179980:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738303104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940658.180045:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738303104:12345-0@lo:400:kworker.0 Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940658.180051:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940658.180142:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738303104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940658.180153:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738303616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940658.180186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940658.180942:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738303616 00000100:00100000:3.0:1788940658.180949:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738303616 00000100:00100000:3.0:1788940658.180990:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940658.181000:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738303616:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788940658.181108:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940658.181182:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738303616:12345-0@lo:400:kworker.0 Request processed in 183us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940658.181189:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940658.181714:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738303616:0@lo:400:kworker.0 00000001:00080000:0.0F:1788940658.306786:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788940658.306815:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788940658.306823:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00100000:0.0:1788940658.306836:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00000020:00000080:0.0:1788940658.306839:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f1befb5800/36f240b4-a296-44d9-a5c6-bed8adad0c38 00000020:00000080:0.0:1788940658.306865:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1befb5800/36f240b4-a296-44d9-a5c6-bed8adad0c38 for lustre-OST0001 00000020:00000080:0.0:1788940658.306931:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1befb3800 for lustre-OST0001 00010000:00010000:1.0:1788940658.348729:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788940658.836041:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00080000:3.0:1788940658.836056:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89f1863fa540 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:3.0:1788940658.836062:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f18df06500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89f1863fa9c0 00000020:00080000:3.0:1788940658.836065:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89f18df06600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89f083816000 00000001:00080000:3.0:1788940658.836090:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1788940658.836373:0:14493:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:0.0:1788940658.836618:0:14493:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788940659.383060:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940659.501858:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788940659.501880:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940659.501922:0:14488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788940659.501928:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788940660.403036:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940661.336209:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00000020:00000080:0.0:1788940661.336217:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f083ecc800/b800dac5-5ff3-48f9-949d-d7448f32aa11 00000001:00100000:0.0:1788940661.336247:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00000020:00000080:0.0:1788940661.336250:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f1befb2000/36f240b4-a296-44d9-a5c6-bed8adad0c38 00000020:00000080:1.0:1788940661.337383:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f083ecc800/b800dac5-5ff3-48f9-949d-d7448f32aa11 for lustre-OST0000 00000020:00000080:1.0:1788940661.337441:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1befb2000/36f240b4-a296-44d9-a5c6-bed8adad0c38 for lustre-OST0000 00000020:00000080:1.0:1788940661.337462:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f083ec8000 for lustre-OST0000 00000020:00000080:1.0:1788940661.337468:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1befb7800 for lustre-OST0000 00010000:00010000:0.0:1788940661.422803:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940661.607737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940661.609260:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718395904 00000100:00100000:2.0:1788940661.609286:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718395904 00000100:00100000:2.0:1788940661.609377:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:2.0:1788940661.609390:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:14435:x1875839718395904:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788940661.609499:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:14435:x1875839718395904:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 Request processed in 113us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940661.609506:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00080000:3.0:1788940661.610277:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940661.628457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940661.628568:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396160 00000100:00100000:1.0:1788940661.628580:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396160 00000100:00100000:1.0:1788940661.628653:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940661.628665:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aefa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:14435:x1875839718396160:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788940661.628942:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aefa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+12:14435:x1875839718396160:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 278us (679us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788940661.628950:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940662.284569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940662.284625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940662.284665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940662.284974:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396288 00000100:00100000:1.0:1788940662.284997:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396288 00000100:00100000:3.0:1788940662.285071:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396544 00000100:00100000:3.0:1788940662.285076:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396544 00000100:00100000:1.0:1788940662.285104:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:1.0:1788940662.285115:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718396288:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940662.285131:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:3.0:1788940662.285137:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718396544:12345-192.168.202.14@tcp:400:kworker.0 00000100:00080000:0.0:1788940662.285196:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940662.285230:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396416 00000100:00100000:0.0:1788940662.285234:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396416 00000100:00100000:0.0:1788940662.285272:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940662.285279:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718396416:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940662.285411:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718396544:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 273us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940662.285420:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00080000:2.0:1788940662.293977:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940662.294537:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718396288:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 9403us (9955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.294552:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:0.0:1788940662.296458:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718396416:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 11168us (11780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940662.296474:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00010000:00010000:2.0:1788940662.445036:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940663.276855:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738304000:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.276938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.277002:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738304512:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.277063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940663.277069:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738304128:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277096:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.277116:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738304640:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.277170:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304512 00000100:00100000:2.0:1788940663.277177:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304512 00000100:00100000:2.0:1788940663.277226:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304640 00000100:00100000:2.0:1788940663.277229:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304640 00000100:00100000:2.0:1788940663.277253:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940663.277261:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738304512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277424:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738304512:12345-0@lo:400:kworker.0 Request processed in 163us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940663.277433:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940663.277452:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940663.277460:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738304640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277668:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738304640:12345-0@lo:400:kworker.0 Request processed in 209us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940663.277676:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940663.277698:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304128 00000100:00100000:2.0:1788940663.277701:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304128 00000100:00100000:2.0:1788940663.277733:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940663.277756:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738304128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.277792:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738304128:12345-0@lo:400:kworker.0 Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940663.278094:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940663.278113:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738304384:0@lo:400:kworker.0 00000100:00080000:2.0:1788940663.278119:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940663.278123:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940663.278146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.278154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738304128:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.278164:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738304640:0@lo:400:kworker.0 00000100:00100000:2.0:1788940663.278173:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738304512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278176:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940663.278181:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738304256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940663.278214:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304384 00000100:00100000:2.0:1788940663.278217:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304384 00000100:00100000:2.0:1788940663.278235:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940663.278241:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738304384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278255:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304256 00000100:00100000:3.0:1788940663.278258:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304256 00000100:00100000:2.0:1788940663.278286:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738304384:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940663.278289:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940663.278293:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788940663.278295:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738304256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278324:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738304256:12345-0@lo:400:kworker.0 Request processed in 30us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940663.278330:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940663.278353:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788940663.278358:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89f1ae852a00, transno 8589934595 00000004:00080000:3.0:1788940663.278368:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788940663.278391:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738304256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278401:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738304384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940663.278412:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940663.278417:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738304768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940663.278441:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940663.278564:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304000 00000100:00100000:1.0:1788940663.278568:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304000 00000100:00100000:1.0:1788940663.278603:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788940663.278610:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940663.278647:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738304000:12345-0@lo:400:kworker.0 Request processed in 38us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.278653:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788940663.278693:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304768 00000100:00100000:1.0:1788940663.278698:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304768 00000100:00100000:1.0:1788940663.278719:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940663.278725:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738304768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940663.278746:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940663.278779:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738304768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.278785:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788940663.278798:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940663.278813:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738304768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940663.278840:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738304000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940663.279214:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940663.279225:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738304896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940663.279254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940663.284560:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738304896 00000100:00100000:0.0:1788940663.284576:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738304896 00000100:00100000:0.0:1788940663.284644:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940663.284656:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738304896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940663.284711:0:16302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940663.285317:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738304896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 662us (6059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940663.285326:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940663.288626:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738304896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940663.468750:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788940663.864961:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000001:00080000:3.0:1788940663.864999:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:1.0:1788940663.865093:0:14493:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:1.0:1788940663.865112:0:14493:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:2.0:1788940664.492910:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940665.517169:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940666.548590:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940667.389009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940667.389060:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940667.389086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940667.389127:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396800 00000100:00100000:1.0:1788940667.389140:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396800 00000100:00100000:1.0:1788940667.389215:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397056 00000100:00100000:1.0:1788940667.389218:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397056 00000100:00100000:1.0:1788940667.389255:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788940667.389266:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2350:x1875839718396800:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940667.389368:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2350:x1875839718396800:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.389377:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788940667.389398:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940667.389405:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718397056:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940667.389432:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718397056:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.389439:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00080000:1.0:1788940667.389461:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940667.389502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940667.389606:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396928 00000100:00100000:1.0:1788940667.389610:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396928 00000100:00100000:1.0:1788940667.389648:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788940667.389655:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718396928:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940667.389701:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718396928:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.389708:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00080000:1.0:1788940667.389724:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940667.392549:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718396672 00000100:00100000:2.0:1788940667.392569:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718396672 00000100:00100000:2.0:1788940667.392652:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:2.0:1788940667.392666:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2350:x1875839718396672:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940667.392779:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2350:x1875839718396672:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 116us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940667.392786:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 131 00010000:00010000:1.0:1788940667.572802:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940668.397005:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738305152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940668.397127:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788940668.397128:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738305280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397156:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397156:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397177:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738305792:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788940668.397193:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738305024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940668.397195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397212:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940668.397215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397217:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738305408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397231:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738305536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940668.397246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940668.397248:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397275:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305664 00000100:00100000:0.0:1788940668.397282:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305664 00000100:00100000:0.0:1788940668.397328:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305792 00000100:00100000:0.0:1788940668.397331:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305792 00000100:00100000:0.0:1788940668.397346:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305536 00000100:00100000:0.0:1788940668.397348:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305536 00000100:00100000:0.0:1788940668.397361:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940668.397367:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738305664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397378:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940668.397402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940668.397416:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738305664:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.397423:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940668.397429:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305152 00000100:00100000:3.0:1788940668.397432:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305152 00000100:00100000:0.0:1788940668.397438:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940668.397444:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738305792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397459:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788940668.397464:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3308:x1875839738305152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940668.397468:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738305792:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.397480:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940668.397490:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3308:x1875839738305152:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.397492:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940668.397496:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940668.397497:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738305536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940668.397545:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738305536:12345-0@lo:400:kworker.0 Request processed in 47us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.397551:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940668.397569:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305280 00000100:00100000:0.0:1788940668.397573:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305280 00000100:00100000:0.0:1788940668.397597:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305408 00000100:00100000:0.0:1788940668.397599:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305408 00000100:00100000:0.0:1788940668.397619:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940668.397625:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738305280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.397645:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940668.397652:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738305408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940668.397653:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738305280:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.397659:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788940668.397675:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940668.397679:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940668.397681:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940668.397755:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738305408:12345-0@lo:400:kworker.0 Request processed in 103us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940668.397763:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940668.397799:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305024 00000100:00100000:3.0:1788940668.397803:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305024 00000100:00100000:3.0:1788940668.397833:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738305920 00000100:00100000:3.0:1788940668.397836:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738305920 00000100:00100000:3.0:1788940668.397849:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940668.397855:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738305024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940668.397883:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940668.397914:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738305024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940668.397927:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940668.397941:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940668.397947:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738305920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940668.397969:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940668.398009:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738305920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940668.398015:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940668.398052:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940668.398305:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738305408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.398315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738305280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.398324:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738305792:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.398359:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738305024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940668.398415:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738305536:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.398423:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738305152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940668.398431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738305664:0@lo:400:kworker.0 00010000:00010000:2.0:1788940668.596048:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940669.616557:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940669.741037:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788940669.741052:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940669.741099:0:14488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788940669.741107:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788940670.638795:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940671.664798:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940672.513934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940672.513980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940672.514016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940672.514044:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397312 00000100:00100000:0.0:1788940672.514063:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397312 00000100:00100000:0.0:1788940672.514124:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:0.0:1788940672.514135:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2353:x1875839718397312:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940672.514208:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2353:x1875839718397312:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940672.514216:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00080000:0.0:1788940672.514241:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940672.514276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940672.514425:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397184 00000100:00100000:3.0:1788940672.514430:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397184 00000100:00100000:3.0:1788940672.514471:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:3.0:1788940672.514480:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2353:x1875839718397184:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940672.514605:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2353:x1875839718397184:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 37us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940672.514613:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:3.0:1788940672.514714:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397568 00000100:00100000:3.0:1788940672.514719:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397568 00000100:00100000:3.0:1788940672.514764:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788940672.514772:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2353:x1875839718397568:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940672.514850:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2353:x1875839718397568:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 79us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940672.514857:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00080000:3.0:1788940672.514927:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940672.515036:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397440 00000100:00100000:1.0:1788940672.515040:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397440 00000100:00100000:1.0:1788940672.515092:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:1.0:1788940672.515100:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2353:x1875839718397440:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940672.515136:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2353:x1875839718397440:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 38us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.515142:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00080000:3.0:1788940672.515236:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788940672.684954:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940673.516794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940673.516820:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738306048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940673.516888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940673.516986:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306048 00000100:00100000:3.0:1788940673.516995:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306048 00000100:00100000:3.0:1788940673.517062:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940673.517074:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738306048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940673.517108:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940673.517150:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738306048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940673.517156:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788940673.517323:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940673.517358:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738306048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940673.519891:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738306304:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.519956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940673.520004:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940673.520010:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738306432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940673.520072:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306304 00000100:00100000:1.0:1788940673.520080:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306304 00000100:00100000:1.0:1788940673.520130:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940673.520140:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738306304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520265:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738306304:12345-0@lo:400:kworker.0 Request processed in 125us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940673.520273:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940673.520310:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306432 00000100:00100000:1.0:1788940673.520313:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306432 00000100:00100000:1.0:1788940673.520340:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940673.520347:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738306432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520378:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738306432:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940673.520384:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940673.520407:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738306560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520431:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940673.520448:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940673.520454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738306176:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520478:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940673.520498:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738306688:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.520543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940673.520567:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306560 00000100:00100000:1.0:1788940673.520571:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306560 00000100:00100000:1.0:1788940673.520591:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306688 00000100:00100000:1.0:1788940673.520594:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306688 00000100:00100000:1.0:1788940673.522570:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940673.522591:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738306560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.522695:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738306560:12345-0@lo:400:kworker.0 Request processed in 112us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940673.522702:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940673.522740:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940673.522749:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738306688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.522781:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738306688:12345-0@lo:400:kworker.0 Request processed in 34us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940673.522800:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940673.522827:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306176 00000100:00100000:1.0:1788940673.522835:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306176 00000100:00100000:1.0:1788940673.522870:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940673.522877:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738306176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.522912:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3307:x1875839738306176:12345-0@lo:400:kworker.0 Request processed in 36us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940673.522919:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788940673.523034:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940673.523040:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940673.523077:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738306432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940673.523091:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738306304:0@lo:400:kworker.0 00000100:00100000:0.0:1788940673.527137:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738306816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940673.527220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940673.527277:0:16302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306816 00000100:00100000:0.0:1788940673.527285:0:16302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306816 00000100:00100000:0.0:1788940673.527328:0:16302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940673.527337:0:16302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738306816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940673.527369:0:16302:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940673.527411:0:16302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738306816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940673.527418:0:16302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940673.527462:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738306816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940673.528129:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738306176:0@lo:400:kworker.0 00000100:00100000:3.0:1788940673.528145:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738306688:0@lo:400:kworker.0 00000100:00100000:3.0:1788940673.528157:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738306560:0@lo:400:kworker.0 00010000:00010000:1.0:1788940673.709061:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940674.732797:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940675.531188:0:17399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 03:57:55 (1788940675) 00010000:00010000:1.0:1788940675.763222:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940676.781856:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940677.639662:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940677.639687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940677.639768:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940677.639803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940677.639807:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397824 00000100:00100000:1.0:1788940677.639819:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397824 00000100:00100000:2.0:1788940677.639830:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718398080 00000100:00100000:2.0:1788940677.639836:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718398080 00000100:00100000:2.0:1788940677.639889:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788940677.639900:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718398080:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940677.640035:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2351:x1875839718398080:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.640044:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:1.0:1788940677.641499:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:1.0:1788940677.641529:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2351:x1875839718397824:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940677.641590:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2351:x1875839718397824:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 80us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940677.641597:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:2.0:1788940677.641807:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397696 00000100:00100000:2.0:1788940677.641815:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397696 00000100:00100000:2.0:1788940677.641849:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00100000:2.0:1788940677.641857:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718397696:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940677.641883:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2351:x1875839718397696:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.641889:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00100000:2.0:1788940677.641919:0:16690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718397952 00000100:00100000:2.0:1788940677.641922:0:16690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718397952 00000100:00100000:2.0:1788940677.641951:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788940677.641957:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718397952:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940677.641979:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2351:x1875839718397952:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 22us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.641985:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00080000:0.0:1788940677.642620:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940677.642625:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940677.805004:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940678.636897:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738306944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.636976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940678.637031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738307456:0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940678.637100:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940678.637106:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940678.637186:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738306944 00000100:00100000:0.0:1788940678.637194:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738306944 00000100:00100000:0.0:1788940678.637236:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788940678.637244:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3306:x1875839738306944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637292:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3306:x1875839738306944:12345-0@lo:400:kworker.0 Request processed in 49us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940678.637299:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788940678.637333:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307456 00000100:00100000:0.0:1788940678.637336:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307456 00000100:00100000:0.0:1788940678.637366:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307328 00000100:00100000:0.0:1788940678.637369:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307328 00000100:00100000:0.0:1788940678.637385:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940678.637391:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637423:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738307456:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940678.637429:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940678.637441:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940678.637446:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738307328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637486:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875839738307328:12345-0@lo:400:kworker.0 Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940678.637492:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788940678.637514:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940678.637570:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875839738307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637580:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738306944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940678.637589:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738307456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.637799:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.637834:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940678.637857:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940678.637863:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.637892:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940678.637908:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738307584:0@lo:400:kworker.0 00000100:00100000:2.0:1788940678.637915:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307200 00000100:00100000:2.0:1788940678.637919:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307200 00000100:00100000:1.0:1788940678.637926:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940678.637943:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940678.637953:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307072 00000100:00100000:2.0:1788940678.637955:0:15140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307072 00000100:00100000:1.0:1788940678.637963:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940678.637974:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940678.637981:0:15140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738307200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.637989:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940678.637995:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738307072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940678.638019:0:15140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738307200:12345-0@lo:400:kworker.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940678.638020:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738307072:12345-0@lo:400:kworker.0 Request processed in 26us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940678.638026:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940678.638092:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307584 00000100:00100000:0.0:1788940678.638096:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307584 00000100:00100000:0.0:1788940678.638120:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940678.638125:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738307584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.638227:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940678.638238:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307200:0@lo:400:kworker.0 00000100:00080000:1.0:1788940678.638272:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940678.638276:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940678.638278:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940678.638578:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307712 00000100:00100000:3.0:1788940678.638582:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307712 00000100:00100000:3.0:1788940678.638612:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940678.638631:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738307712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940678.638662:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940678.638723:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738307712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940678.638729:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940678.639154:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738307712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940678.639270:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940678.639284:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738307840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940678.639323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940678.639874:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307840 00000100:00100000:1.0:1788940678.639880:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307840 00000100:00100000:1.0:1788940678.639921:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940678.639931:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738307840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940678.639958:0:15142:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940678.640008:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738307840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940678.640014:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940678.640049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738307840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940678.640793:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875839738307584:12345-0@lo:400:kworker.0 Request processed in 2665us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940678.640803:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940678.640843:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738307584:0@lo:400:kworker.0 00000100:00100000:2.0:1788940678.642472:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1788940678.830129:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940679.266296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940679.266479:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718398208 00000100:00100000:1.0:1788940679.266513:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718398208 00000100:00100000:1.0:1788940679.266651:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940679.266665:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b709d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2350:x1875839718398208:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940679.266696:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940679.266721:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521600/0x27a633fcdd4be82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b63 expref: 13 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.266745:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940679.266825:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b709d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584847da-857b-4e92-a9b9-d2025c0d7e63+12:2350:x1875839718398208:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 163us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940679.266833:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940679.268878:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940679.268921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940679.268962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940679.269042:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718398336 00000100:00100000:3.0:1788940679.269056:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718398336 00000100:00100000:3.0:1788940679.269123:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718398464 00000100:00100000:3.0:1788940679.269127:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718398464 00000100:00100000:3.0:1788940679.269160:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940679.269171:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+13:2353:x1875839718398336:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940679.269188:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940679.269213:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa96600/0x27a633fcdd4be7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b39 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940679.269234:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940679.269297:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+12:2353:x1875839718398336:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 127us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940679.269304:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940679.269324:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788940679.269403:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:2352:x1875839718398464:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940679.269433:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940679.269443:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520400/0x27a633fcdd4bf23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c04 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940679.269454:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940679.269474:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+10:2352:x1875839718398464:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 143us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940679.269480:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:0.0:1788940679.269816:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718398720 00000100:00100000:0.0:1788940679.269821:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718398720 00000100:00100000:0.0:1788940679.269877:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788940679.269886:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+6:2349:x1875839718398720:12345-192.168.202.14@tcp:9:umount.0 00000020:00000080:0.0:1788940679.269924:0:15141:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4be9e 00000020:00010000:0.0:1788940679.269932:0:15141:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f083ece800: total 0 00000100:00080000:0.0:1788940679.269937:0:15141:0:(import.c:65:import_set_state_nolock()) ffff89f083ec8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940679.269976:0:15141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:0.0:1788940679.270239:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b800dac5-5ff3-48f9-949d-d7448f32aa11+4:2349:x1875839718398720:12345-192.168.202.14@tcp:9:umount.0 Request processed in 355us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940679.270254:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000020:00010000:0.0:1788940679.270269:0:14443:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f083ece800: total 0 00010000:00010000:0.0:1788940679.270282:0:14443:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f083ece800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788940679.270313:0:14443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788940679.270316:0:14443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788940653 -> 1788940654 00002000:00010000:0.0:1788940679.270318:0:14443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788940653 -> 1788940654 00002000:00010000:0.0:1788940679.270320:0:14443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00080000:3.0:1788940679.270503:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940679.271287:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7d605f/0x27a633fcdd4c1e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cdd expref: 3 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940679.271328:0:14443:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f083ece800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788940679.271423:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940679.271426:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940679.271428:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940679.283059:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940679.283153:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718399616 00000100:00100000:0.0:1788940679.283167:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718399616 00000100:00100000:0.0:1788940679.283255:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:0.0:1788940679.283266:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+11:2349:x1875839718399616:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:0.0:1788940679.283310:0:16687:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4be90 00000020:00010000:0.0:1788940679.283337:0:16687:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f083ecd000: total 0 00000100:00080000:0.0:1788940679.283341:0:16687:0:(import.c:65:import_set_state_nolock()) ffff89f08382c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940679.283376:0:16687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788940679.283917:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b800dac5-5ff3-48f9-949d-d7448f32aa11+10:2349:x1875839718399616:12345-192.168.202.14@tcp:39:umount.0 Request processed in 650us (873us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788940679.283925:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000020:00010000:1.0:1788940679.284113:0:14442:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f083ecd000: total 0 00010000:00010000:1.0:1788940679.284117:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940679.284174:0:14442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f083ecd000, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1788940679.284217:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89f188f81800) 00010000:00010000:1.0:1788940679.284221:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940679.284229:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96c00/0x27a633fcdd4c130 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5ca5 expref: 9 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284251:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f188f81400) 00010000:00010000:1.0:1788940679.284252:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940679.284255:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d000/0x27a633fcdd4bf5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c12 expref: 8 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284278:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:1.0:1788940679.284280:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940679.284282:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f19258d600/0x27a633fcdd4bf93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c20 expref: 7 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284292:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89f18a6ce600) 00010000:00010000:1.0:1788940679.284293:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940679.284295:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c18b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cba expref: 6 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284304:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f186931900) 00010000:00010000:1.0:1788940679.284305:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940679.284307:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521c00/0x27a633fcdd4bf3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c0b expref: 5 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284319:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89f188f81900) 00010000:00010000:1.0:1788940679.284321:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788940679.284323:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ebe00/0x27a633fcdd4c018 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c4a expref: 4 pid: 16687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940679.284344:0:14442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f083ecd000, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1788940679.284353:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940679.284354:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940679.284356:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940679.284430:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940679.853471:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940679.980913:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940679.980927:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940679.981000:0:14488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940679.981015:0:14488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788940680.884041:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940681.350475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940681.350600:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940681.350701:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400128 00000100:00100000:3.0:1788940681.350718:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400128 00000100:00100000:1.0:1788940681.350726:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400000 00000100:00100000:1.0:1788940681.350749:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400000 00000100:00100000:3.0:1788940681.350836:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:3.0:1788940681.350931:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+11:2350:x1875839718400128:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940681.350952:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940681.350977:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eac00/0x27a633fcdd4beba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bc5 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.350999:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940681.351080:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+10:2350:x1875839718400128:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 155us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940681.351929:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:3.0:1788940681.351973:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788940681.351987:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+9:2351:x1875839718400000:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940681.352003:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940681.352019:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4beb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b9b expref: 9 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.352052:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940681.352159:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:584847da-857b-4e92-a9b9-d2025c0d7e63+8:2351:x1875839718400000:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 177us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940681.352167:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940681.353361:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940681.353450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940681.353727:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718399872 00000100:00100000:2.0:1788940681.353738:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718399872 00000100:00100000:2.0:1788940681.353827:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:2.0:1788940681.353839:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+6:2349:x1875839718399872:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:2.0:1788940681.353890:0:14454:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bec8 00000020:00010000:2.0:1788940681.353901:0:14454:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f083ec9000: total 0 00000100:00080000:2.0:1788940681.353906:0:14454:0:(import.c:65:import_set_state_nolock()) ffff89f083ec9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940681.353938:0:14454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1788940681.354217:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36f240b4-a296-44d9-a5c6-bed8adad0c38+5:2349:x1875839718399872:12345-192.168.202.14@tcp:39:umount.0 Request processed in 379us (766us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788940681.354225:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000020:00010000:2.0:1788940681.354338:0:14443:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f083ec9000: total 0 00010000:00010000:2.0:1788940681.354380:0:14443:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f083ec9000, canceled 0 locks, left on hash table 1. 00000100:00080000:3.0:1788940681.354515:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940681.355052:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f188f81300) 00010000:00010000:2.0:1788940681.355057:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940681.355071:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f181521a00/0x27a633fcdd4bfa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5c27 expref: 4 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.355142:0:14443:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f083ec9000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788940681.355161:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940681.355163:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940681.355165:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940681.365838:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400256 00000100:00100000:1.0:1788940681.365865:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400256 00000100:00100000:1.0:1788940681.365980:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940681.365993:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:584847da-857b-4e92-a9b9-d2025c0d7e63+8:2351:x1875839718400256:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940681.366014:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940681.366040:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4bf1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5bfd expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940681.366062:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940681.366163:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:584847da-857b-4e92-a9b9-d2025c0d7e63+7:2351:x1875839718400256:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 171us (12808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940681.366170:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788940681.382733:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940681.382849:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400512 00000100:00100000:2.0:1788940681.382863:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400512 00000100:00100000:2.0:1788940681.382934:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:2.0:1788940681.382947:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+7:2349:x1875839718400512:12345-192.168.202.14@tcp:251:umount.0 00000020:00000080:2.0:1788940681.383027:0:14448:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4be6d 00000020:00010000:2.0:1788940681.383039:0:14448:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f083eca800: total 0 00000100:00080000:2.0:1788940681.383046:0:14448:0:(import.c:65:import_set_state_nolock()) ffff89f083ecc000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940681.383156:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:584847da-857b-4e92-a9b9-d2025c0d7e63+3:2349:x1875839718400512:12345-192.168.202.14@tcp:251:umount.0 Request processed in 210us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940681.383165:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 137 00000020:00010000:1.0:1788940681.383293:0:14442:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f083eca800: total 0 00010000:00010000:1.0:1788940681.383299:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940681.383355:0:14442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f083eca800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788940681.383398:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4be74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5b32 expref: 2 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940681.383416:0:14442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f083eca800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788940681.383436:0:14442:0:(genops.c:893:class_export_put()) final put ffff89f083eca800/584847da-857b-4e92-a9b9-d2025c0d7e63 00010000:00010000:1.0:1788940681.383457:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940681.383460:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940681.383461:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940681.383795:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f083eca800/584847da-857b-4e92-a9b9-d2025c0d7e63 for MGS 00000020:00000080:2.0:1788940681.383842:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f083ecc000 for MGS 00010000:00010000:2.0:1788940681.900902:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940682.928966:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788940683.328266:0:17594:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788940683.353876:0:17594:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788940683.353936:0:17594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.353952:0:17594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.353959:0:17594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.353966:0:17594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.353996:0:17594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788940683.354001:0:17594:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788940683.354025:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940683.354029:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788940683.354035:0:17594:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788940683.354062:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f1bf53c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788940683.354155:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738307968:0@lo:39:umount.0 00000100:00100000:3.0:1788940683.354242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940683.355879:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940683.355896:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.355911:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940683.355916:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.355928:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940683.355961:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940683.355968:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940683.355971:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788940683.355975:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788940683.356024:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.356031:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940683.356073:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.356081:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3800/0x27a633fcdd4bb9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bba3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.356099:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940683.356101:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940683.356105:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940683.356112:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940683.356308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940683.356434:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308096 00000100:00100000:2.0:1788940683.356443:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308096 00000100:00100000:2.0:1788940683.356509:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940683.356551:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3306:x1875839738308096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940683.356567:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940683.356589:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daa800/0x27a633fcdd4bba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bb9c expref: 19 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.356616:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940683.356656:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738307968 00000100:00100000:0.0:1788940683.356666:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738307968 00000100:00100000:2.0:1788940683.356678:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:3306:x1875839738308096:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940683.356700:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940683.356770:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.356869:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940683.356881:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875839738307968:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788940683.356917:0:16687:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bbcd 00000100:00080000:0.0:1788940683.356931:0:16687:0:(import.c:65:import_set_state_nolock()) ffff89f1bf538000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788940683.357037:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1875839738307968:12345-0@lo:39:umount.0 Request processed in 159us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.357045:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00000080:0.0:1788940683.357057:0:16687:0:(genops.c:893:class_export_put()) final put ffff89f1bf53c800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788940683.357093:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bf53c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788940683.357101:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940683.357108:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738307968:0@lo:39:umount.0 00000020:00000080:1.0:1788940683.359424:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940683.359549:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bf538000 for lustre-MDT0000 00000100:00080000:1.0:1788940683.359581:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940683.359586:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788940683.359594:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788940683.362981:0:17594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363000:0:17594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363022:0:17594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363029:0:17594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363053:0:17594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940683.363059:0:17594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363066:0:17594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363073:0:17594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363079:0:17594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363094:0:17594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788940683.363100:0:17594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363107:0:17594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363113:0:17594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363129:0:17594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363136:0:17594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788940683.363142:0:17594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363149:0:17594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363156:0:17594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363163:0:17594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.363170:0:17594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788940683.363173:0:17594:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788940683.363188:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940683.363203:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363214:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97e00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940683.363219:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363231:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940683.363239:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940683.363246:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940683.363263:0:14442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788940683.363267:0:14442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788940683.363318:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363325:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940683.363376:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363386:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97e00/0x27a633fcdd4bb02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bb09 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788940683.363391:0:17594:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788940683.363398:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:0.0:1788940683.363404:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00000080:1.0:1788940683.363405:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788940683.363413:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788940683.363415:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:0.0:1788940683.363427:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eae00 already unused, calling callback (ffffffffc1d10c20) 00000020:00080000:1.0:1788940683.363432:0:17594:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff89f1ae836800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:0.0:1788940683.363434:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940683.363460:0:17594:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff89f1bee0c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788940683.363464:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940683.363473:0:17594:0:(genops.c:1827:print_export_data()) lustre-MDT0000: UNLINKED ffff89f083ec9000 36f240b4-a296-44d9-a5c6-bed8adad0c38 192.168.202.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 10000000:00010000:0.0:1788940683.363478:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940683.363488:0:17594:0:(genops.c:1827:print_export_data()) lustre-MDT0000: UNLINKED ffff89f083ecd000 b800dac5-5ff3-48f9-949d-d7448f32aa11 192.168.202.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 10000000:01000000:0.0:1788940683.363495:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00080000:1.0:1788940683.363500:0:17594:0:(genops.c:1561:class_disconnect_exports()) OBD device 5 (ffff89f1bf86b3b0) has exports, disconnecting them 10000000:01000000:0.0:1788940683.363501:0:14442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788940683.363503:0:14442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1788940683.363515:0:17594:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89f1ae836800), last request at 1788940678 00000020:00000080:1.0:1788940683.363550:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bd86 00010000:00010000:0.0:1788940683.363557:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940683.363571:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f1ae833000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788940683.363585:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940683.363595:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363602:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812eae00/0x27a633fcdd4bd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bd9b expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363624:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940683.363628:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363634:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc1d10c20) 00000020:00080000:1.0:1788940683.363635:0:17594:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1ae836800): rc 0 10000000:00010000:0.0:1788940683.363652:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788940683.363653:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1ae836800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1788940683.363667:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940683.363675:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940683.363679:0:17594:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89f1bee0c000), last request at 1788940678 10000000:01000000:0.0:1788940683.363693:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:1.0:1788940683.363695:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bc52 10000000:01000000:0.0:1788940683.363701:0:14442:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788940683.363706:0:14442:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1788940683.363708:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f1bee0d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788940683.363723:0:17594:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1bee0c000): rc 0 00000020:00000080:1.0:1788940683.363725:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1bee0c000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788940683.363732:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1788940683.363737:0:17594:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff98fc41923ae0 00010000:00010000:0.0:1788940683.363742:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788940683.363760:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788940683.363765:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00010000:00010000:0.0:1788940683.363771:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940683.363780:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788940683.363792:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258d400/0x27a633fcdd4bf0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf15 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363804:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940683.363808:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363814:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940683.363817:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363824:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940683.363830:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940683.363835:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940683.363838:0:14442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788940683.363841:0:14442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788940683.363859:0:17594:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1788940683.363865:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.363873:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940683.363881:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940683.363885:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788940683.363888:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96000/0x27a633fcdd4baf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bafb expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940683.363904:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940683.363909:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:1.0:1788940683.363920:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788940683.363924:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940683.363930:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940683.363932:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940683.363960:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738308352:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788940683.363991:0:17594:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788940683.364004:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788940683.364038:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff89f1bf86b3b0) has no exports 00000100:00100000:0.0:1788940683.364063:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.364147:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940683.364158:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738308224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.364187:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788940683.364219:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1ae836800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788940683.364274:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee0c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788940683.364307:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1ae833000 for lustre-MDT0000 00000020:00000080:0.0:1788940683.364316:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bee0d000 for lustre-MDT0000 00000100:00100000:0.0:1788940683.364336:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308352 00000100:00100000:0.0:1788940683.364345:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308352 00000100:00100000:0.0:1788940683.364400:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308224 00000100:00100000:0.0:1788940683.364404:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308224 00000100:00100000:0.0:1788940683.364424:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940683.364433:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b709fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+19:3308:x1875839738308352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940683.364449:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940683.364465:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188daae00/0x27a633fcdd4bd9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bd94 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.364484:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940683.364561:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b709fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+18:3308:x1875839738308352:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.364569:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940683.364628:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940683.364635:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:3308:x1875839738308224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940683.364655:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940683.364665:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188dabe00/0x27a633fcdd4bb09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bb02 expref: 17 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.364673:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940683.364695:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3308:x1875839738308224:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.364701:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940683.364731:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.364758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.364776:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940683.364781:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.364799:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.364817:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308608 00000100:00100000:0.0:1788940683.364821:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308608 00000100:00100000:0.0:1788940683.364839:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308480 00000100:00100000:0.0:1788940683.364841:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308480 00000100:00100000:0.0:1788940683.364853:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940683.364860:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+17:3306:x1875839738308608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940683.364868:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940683.364877:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3c00/0x27a633fcdd4bafb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4baf4 expref: 17 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.364890:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940683.364913:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+16:3306:x1875839738308608:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.364928:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940683.364940:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940683.364946:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+15:3306:x1875839738308480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940683.364953:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940683.364962:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521000/0x27a633fcdd4bf15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bf0e expref: 15 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.364971:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940683.364989:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f+14:3306:x1875839738308480:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.364994:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940683.365029:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738308224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.365039:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3308:1875839738308352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.365067:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940683.365074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738308608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940683.365301:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738308736:0@lo:9:umount.0 00000100:00100000:3.0:1788940683.365345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.365381:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738308864:0@lo:9:umount.0 00000100:00100000:3.0:1788940683.365403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.365438:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308736 00000100:00100000:3.0:1788940683.365442:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308736 00000100:00100000:3.0:1788940683.365483:0:15139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308864 00000100:00100000:3.0:1788940683.365486:0:15139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308864 00000100:00100000:3.0:1788940683.365509:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940683.365538:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875839738308736:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788940683.365568:0:15139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bc6e 00000100:00080000:3.0:1788940683.365577:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940683.365619:0:15139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788940683.366077:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1875839738308736:12345-0@lo:9:umount.0 Request processed in 559us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.366086:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940683.366114:0:15139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940683.366121:0:15139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875839738308864:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788940683.366135:0:15139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bda2 00000100:00080000:3.0:1788940683.366142:0:15139:0:(import.c:65:import_set_state_nolock()) ffff89f08382a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940683.366157:0:15139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1788940683.366257:0:15139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1875839738308864:12345-0@lo:9:umount.0 Request processed in 136us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.366263:0:15139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788940683.366293:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940683.366297:0:14450:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940683.366317:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940683.366431:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f194b4f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788940683.366461:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788940683.366464:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940683.366470:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738308736:0@lo:9:umount.0 00000100:00080000:1.0:1788940683.366486:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192361800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788940683.366490:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788940683.366491:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940683.366507:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738308864:0@lo:9:umount.0 00010000:00010000:2.0:1788940683.366738:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788940683.375870:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff89f1bf86b3b0) has no exports 00000020:00000080:1.0:1788940683.421289:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb4f 00000020:00000080:1.0:1788940683.421313:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f190701800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788940683.421380:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788940683.421456:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f190701800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788940683.421497:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940683.421510:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940683.421515:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 7 (ffff89f1b5c799d8) has no exports 00000020:00000080:0.0:1788940683.422834:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb48 00000020:00000080:0.0:1788940683.422848:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f191c4f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940683.422931:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f191c4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940683.423233:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940683.423247:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788940683.423252:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1914c6000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788940683.423254:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1914c6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788940683.423286:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1788940683.757308:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738309120:0@lo:400:kworker.0 00000100:00100000:2.0:1788940683.757371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738308992:0@lo:400:kworker.0 00000100:00100000:2.0:1788940683.757408:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.757461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940683.757511:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738308992 00000100:00100000:1.0:1788940683.757511:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738309120 00000100:00100000:1.0:1788940683.757542:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738309120 00000100:00100000:2.0:1788940683.757560:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738308992 00000100:00100000:1.0:1788940683.757602:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788940683.757611:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875839738309120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788940683.757620:0:14455:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788940683.757686:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875839738309120:12345-0@lo:400:kworker.0 Request processed in 74us (225us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940683.757791:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940683.757798:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875839738308992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788940683.757804:0:14454:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788940683.757838:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875839738308992:12345-0@lo:400:kworker.0 Request processed in 40us (429us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940683.757845:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788940683.757907:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940683.757972:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788940683.757977:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788940683.757978:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788940683.758010:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940683.758014:0:3308:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788940683.758017:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788940683.758023:0:3308:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940683.758027:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 565 00000100:00080000:1.0:1788940683.758036:0:3308:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1bee98800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940683.758064:0:3308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6ca80 x1875839738309248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940683.758088:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875839738309120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940683.758113:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738309248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788940683.758158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.758221:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738309248 00000100:00100000:1.0:1788940683.758226:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738309248 00000100:00100000:1.0:1788940683.758247:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940683.758252:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738309248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788940683.758270:0:16687:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788940683.766577:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940683.766590:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788940683.766600:0:3307:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1bee9d800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940683.766674:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd3480 x1875839738309376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940683.766701:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738308992:0@lo:400:kworker.0 00000100:00100000:0.0:1788940683.778103:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738309376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788940683.779959:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.781187:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738309376 00000100:00100000:3.0:1788940683.781203:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738309376 00000100:00100000:3.0:1788940683.781266:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788940683.781276:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875839738309376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788940683.781301:0:14455:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788940683.781398:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875839738309376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 122us (1449us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940683.781406:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788940683.784176:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940683.784195:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940683.784204:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738309376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788940683.799062:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875839738309248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40798us (40894us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940683.799100:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788940683.799191:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940683.799202:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788940683.799207:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738309248:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1788940683.858828:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00000020:00000080:3.0:1788940683.858838:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f083ece800/b800dac5-5ff3-48f9-949d-d7448f32aa11 00000001:00100000:3.0:1788940683.858867:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940683.858870:0:7662:0:(genops.c:893:class_export_put()) final put ffff89f08382b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940683.859032:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f083ece800/b800dac5-5ff3-48f9-949d-d7448f32aa11 for lustre-OST0001 00000020:00000080:0.0:1788940683.859085:0:38:0:(genops.c:852:class_export_destroy()) destroying export ffff89f08382b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788940683.859105:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f083ec8800 for lustre-OST0001 00000020:00000080:0.0:1788940683.859110:0:38:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f08382a800 for lustre-OST0001 00010000:00010000:3.0:1788940683.948696:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940684.394176:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b800dac5-5ff3-48f9-949d-d7448f32aa11 00000001:00080000:3.0:1788940684.394192:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788940684.394196:0:5883:0:(genops.c:893:class_export_put()) final put ffff89f083ecd000/b800dac5-5ff3-48f9-949d-d7448f32aa11 00000001:00100000:3.0:1788940684.395072:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36f240b4-a296-44d9-a5c6-bed8adad0c38 00000001:00080000:3.0:1788940684.395108:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1788940684.395113:0:5883:0:(genops.c:893:class_export_put()) final put ffff89f083ec9000/36f240b4-a296-44d9-a5c6-bed8adad0c38 00000020:00000080:0.0:1788940684.398878:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f083ecd000/b800dac5-5ff3-48f9-949d-d7448f32aa11 for lustre-MDT0000 00000020:00000080:0.0:1788940684.399177:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f08382c000 for lustre-MDT0000 00000020:00000080:0.0:1788940684.403597:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f083ec9000/36f240b4-a296-44d9-a5c6-bed8adad0c38 for lustre-MDT0000 00000020:00000080:3.0:1788940684.407934:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f083ec9800 for lustre-MDT0000 00010000:00010000:2.0:1788940684.972902:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788940685.485072:0:17594:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f18de72300 - data ffff89f1821d3438/ffff89f1b691d000 00000020:01000000:0.0:1788940685.485204:0:17594:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f192711300 - data ffff89f1a9ab3e58/ffff89f08272b800 00000001:00000004:0.0:1788940685.495604:0:17594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:3.0:1788940685.579245:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940685.579255:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788940685.579335:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940685.579338:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788940685.590660:0:14476:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788940685.590668:0:14476:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788940685.590678:0:14476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788940685.591636:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940685.591641:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788940685.591653:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940685.591656:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940685.592255:0:14478:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940685.592259:0:14478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788940685.592268:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788940685.689370:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb17 00000020:00000080:3.0:1788940685.689386:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f183938000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940685.690794:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb2c 00000020:00000080:3.0:1788940685.690807:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1901aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940685.691536:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f183938000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788940685.691692:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788940685.691700:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.691711:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788940685.691715:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 4 (ffff89f1bf8699d8) has no exports 00000004:01000000:3.0:1788940685.691896:0:17594:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788940685.691906:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb79 00000020:00000080:3.0:1788940685.691911:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b0641000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940685.692378:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901aa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788940685.692459:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788940685.692465:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.692472:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788940685.692475:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 9 (ffff89f1982e0000) has no exports 00000020:00000080:3.0:1788940685.692482:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb72 00000020:00000080:3.0:1788940685.692487:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f192366800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940685.693326:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0641000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788940685.693822:0:17594:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788940685.693828:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940685.693834:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:3.0:1788940685.693841:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940685.693862:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940685.694373:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f192366800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940685.694483:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.694494:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940685.694502:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb64 00000020:00000080:3.0:1788940685.694511:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b0645000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940685.694577:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f192361800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788940685.694584:0:37:0:(genops.c:893:class_export_put()) final put ffff89f191c4b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940685.694586:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f191c4b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788940685.694591:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940685.694684:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0645000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788940685.694727:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788940685.694732:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.694737:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788940685.694740:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 8 (ffff89f1b5184d88) has no exports 00000020:00000080:3.0:1788940685.694747:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb5d 00000020:00000080:3.0:1788940685.694751:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b0645800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940685.695123:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0645800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788940685.695750:0:17594:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788940685.695755:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940685.695759:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788940685.695765:0:17594:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940685.695767:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940685.695881:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.695889:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940685.695917:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.695920:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940685.695924:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f194b4c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940685.695927:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f194b4c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788940685.695932:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940685.696081:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb33 00000020:00000080:3.0:1788940685.696087:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1901aa000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788940685.696293:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f194b4f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788940685.696301:0:37:0:(genops.c:893:class_export_put()) final put ffff89f1b0643000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940685.696304:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0643000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788940685.696308:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940685.696456:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788940685.696463:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.696468:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788940685.696472:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 6 (ffff89f1bf868000) has no exports 00000020:00000080:3.0:1788940685.696492:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.696496:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788940685.696501:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bb3a 00000020:00000080:3.0:1788940685.696553:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1901ab800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940685.696883:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901aa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788940685.696889:0:37:0:(genops.c:893:class_export_put()) final put ffff89f1901ad000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788940685.696891:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901ad000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788940685.696901:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1788940685.697264:0:17594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1b0c14800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788940685.697269:0:17594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b0c14800 3 00000020:01000004:3.0:1788940685.697273:0:17594:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f1b0c14800 from lustre-MDT0000 00000020:00000080:3.0:1788940685.697293:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.697298:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788940685.697301:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f18393f000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788940685.697303:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18393f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788940685.697313:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788940685.697350:0:17594:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788940685.697354:0:17594:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788940685.697357:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788940685.697359:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.697362:0:17594:0:(obd_config.c:1048:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940685.697370:0:17594:0:(genops.c:1827:print_export_data()) MGS: ACTIVE ffff89f1834b5800 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940685.697375:0:17594:0:(genops.c:1561:class_disconnect_exports()) OBD device 1 (ffff89f1980199d8) has exports, disconnecting them 00000020:00080000:3.0:1788940685.697380:0:17594:0:(genops.c:1536:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89f1834b5800), last request at 1788940585 00000020:00000080:3.0:1788940685.697396:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4badf 00000020:00010000:3.0:1788940685.697401:0:17594:0:(genops.c:1929:obd_stale_export_put()) Put export ffff89f1834b5800: total 1 00000100:00080000:3.0:1788940685.697405:0:17594:0:(import.c:65:import_set_state_nolock()) ffff89f1834b0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788940685.697717:0:17594:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1834b5800): rc 0 00000020:00080000:3.0:1788940685.697724:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 1 (ffff89f1980199d8) has no exports 00000020:00000080:1.0:1788940685.697845:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1901ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788940685.697893:0:14442:0:(genops.c:1915:obd_stale_export_get()) Get export ffff89f1834b5800: total 0 00010000:00010000:0.0:1788940685.697928:0:14442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89f1834b5800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788940685.697958:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4bc05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bbfe expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698136:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f188dab400/0x27a633fcdd4bc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bc0c expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698227:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ea600/0x27a633fcdd4bd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bd6a expref: 7 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698242:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad2800/0x27a633fcdd4bc3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bc36 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698254:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa96800/0x27a633fcdd4bef9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bef2 expref: 5 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698265:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f082ad3200/0x27a633fcdd4baed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bae6 expref: 4 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698275:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258d200/0x27a633fcdd4bd47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bd40 expref: 3 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698287:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258c400/0x27a633fcdd4bf07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27a633fcdd4bf00 expref: 2 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940685.698298:0:14442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89f1834b5800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788940685.698311:0:14442:0:(genops.c:893:class_export_put()) final put ffff89f1834b5800/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f 00010000:00010000:0.0:1788940685.698362:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940685.698364:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940685.698367:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940685.698395:0:14449:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89f1c180a400:14449] 2 exiting: rc = 0 00000020:00000080:1.0:1788940685.698609:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1834b5800/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f for MGS 00000100:00100000:2.0:1788940685.698767:0:14446:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89f1b346dc00:14446] 0 exiting: rc = 1 00000100:00100000:2.0:1788940685.698820:0:14448:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89f1c180a600:14448] 1 exiting: rc = 0 00000100:00100000:3.0:1788940685.699186:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699196:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699202:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699208:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699214:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699219:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699225:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699231:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699236:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699243:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699259:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699264:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699275:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699281:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699287:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699293:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699299:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699305:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699311:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699317:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699323:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699329:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699335:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699341:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699346:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699352:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699358:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699363:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699369:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699374:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699381:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699389:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699396:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699401:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699407:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699412:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699418:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699423:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699429:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699434:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699439:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699443:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699448:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699454:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699459:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699471:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699476:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699481:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699485:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699490:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699495:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699500:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699505:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699510:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699533:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699541:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699547:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699552:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699558:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699563:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699568:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699573:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699579:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940685.699585:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788940685.699994:0:17594:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788940685.699997:0:17594:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1788940685.700924:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1834b0000 for MGS 00000020:01000000:3.0:1788940685.701377:0:17594:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1835c9800 - data ffff89f1a9ab00d8/ffff89f0829cd400 00000020:01000000:3.0:1788940685.701493:0:17594:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f08288e000 - data ffff89f1a980fca8/ffff89f1ae7f3c00 00000020:00000080:3.0:1788940685.701924:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bac3 00000020:00000080:3.0:1788940685.701932:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b590c000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788940685.701952:0:17594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1b0c14800 from MGS, refs=2 00000020:01000004:3.0:1788940685.701955:0:17594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b0c14800 2 00000020:01000004:3.0:1788940685.701958:0:17594:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f1b0c14800 from MGS 00000020:00000080:3.0:1788940685.701979:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940685.701986:0:17594:0:(obd_config.c:958:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788940685.702001:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b5909800/MGS 00000020:00000080:0.0:1788940685.702164:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b590c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940685.702253:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5909800/MGS for MGS 00000020:01000000:3.0:1788940685.702261:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788940685.702321:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788940685.702337:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940685.702343:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940685.702350:0:17594:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89f1b5c73800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940685.702355:0:17594:0:(genops.c:1561:class_disconnect_exports()) OBD device 10 (ffff89f1bf86cd88) has exports, disconnecting them 00000020:00080000:3.0:1788940685.702360:0:17594:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89f1b5c73800), last request at 1788940586 00000020:00000080:3.0:1788940685.702365:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bbb1 00000020:00080000:3.0:1788940685.702374:0:17594:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1b5c73800): rc 0 00000020:00000080:3.0:1788940685.702379:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b5c73800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788940685.703200:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c73800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788940685.703732:0:17594:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788940685.703737:0:17594:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940685.703741:0:17594:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940685.703747:0:17594:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940685.703768:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bf53c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788940685.703895:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940685.703902:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788940685.703906:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1af52b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788940685.703909:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1af52b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788940685.703915:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788940685.703966:0:17594:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b0c14800 1 00000020:00000080:0.0:1788940685.703971:0:17594:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bab5 00000020:00000080:0.0:1788940685.703976:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b590b000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788940685.703983:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788940685.704002:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b590b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940685.704018:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940685.704022:0:17594:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940685.704025:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 0 (ffff89f1b5c7b3b0) has no exports 00000020:00000080:1.0:1788940685.730694:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940685.730711:0:17594:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788940685.730717:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b0c14000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940685.730721:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0c14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788940685.730731:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788940685.730874:0:17594:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f1b0c15800 00000020:01000000:1.0:1788940685.730896:0:17594:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788940685.730901:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940685.730906:0:17594:0:(obd_config.c:1048:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788940685.730910:0:17594:0:(genops.c:1566:class_disconnect_exports()) OBD device 3 (ffff89f1b5c7cd88) has no exports 00000100:00100000:3.0:1788940685.732251:0:14455:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff89f191360400:14455] 1 exiting: rc = 0 00000100:00100000:2.0:1788940685.732508:0:14454:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89f191361400:14454] 0 exiting: rc = 1 00000100:00100000:2.0:1788940685.732612:0:16687:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89f1b5c17200:16687] 3 exiting: rc = 0 00000100:00100000:1.0:1788940685.734233:0:14456:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff89f191f3c200:14456] 2 exiting: rc = 0 00000100:00100000:1.0:1788940685.734334:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734342:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734350:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734356:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734362:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734368:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734373:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734379:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734385:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734391:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734397:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734403:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734409:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734415:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734421:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734427:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734433:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734444:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734464:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734470:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734477:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734484:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734490:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734497:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734503:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734510:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734535:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734543:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734549:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734554:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734559:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734564:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734569:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734575:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734582:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734588:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734594:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734600:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734610:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734635:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734642:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734652:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734661:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734667:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734673:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734679:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734685:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734691:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734696:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734701:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734706:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734711:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734717:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734730:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734735:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734741:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734747:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734752:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734758:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734764:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734770:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734776:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734782:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.734791:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.737371:0:14457:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89f191f3de00:14457] 0 exiting: rc = 1 00000100:00100000:3.0:1788940685.740956:0:14458:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89f1b346d400:14458] 1 exiting: rc = 0 00000100:00100000:1.0:1788940685.741709:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741718:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741723:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741730:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741735:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741741:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741746:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741750:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741755:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741760:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741765:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741770:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741776:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741781:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741786:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741791:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741796:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741801:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741806:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741811:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741816:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741821:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741825:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741841:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741847:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741852:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741857:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741862:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741867:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741872:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741877:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741882:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741888:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741893:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741898:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741903:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741907:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741912:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741917:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741922:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741927:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741931:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741936:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741941:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741946:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741950:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741954:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741959:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741963:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741968:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741973:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741979:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741985:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741992:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.741997:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742013:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742019:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742025:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742036:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742042:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742047:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742052:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742057:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.742062:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940685.743012:0:14459:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89f1a955e600:14459] 0 exiting: rc = 1 00000100:00100000:0.0:1788940685.743608:0:14460:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89f1a955f600:14460] 1 exiting: rc = 0 00000100:00100000:1.0:1788940685.745810:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745821:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745827:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745834:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745856:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745864:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745870:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745876:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745882:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745888:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745894:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745900:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745907:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745914:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745921:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745927:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745949:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745956:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745963:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745970:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745977:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745983:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745989:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.745997:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746017:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746025:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746031:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746039:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746062:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746331:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746337:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746343:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746349:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746355:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746363:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746369:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746377:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746384:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746392:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746398:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746422:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746432:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746438:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746446:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746453:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746459:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746465:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746471:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746478:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746485:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746492:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746498:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746550:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746559:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746565:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746572:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746578:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746586:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746592:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746599:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746605:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746611:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746617:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.746637:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.759416:0:14461:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89f1923c1800:14461] 0 exiting: rc = 1 00000100:00100000:3.0:1788940685.759740:0:14462:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89f188ed5800:14462] 1 exiting: rc = 0 00000100:00100000:1.0:1788940685.761050:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761060:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761065:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761080:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761086:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761092:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761096:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761101:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761106:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761110:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761116:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761120:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761125:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761130:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761136:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761141:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761146:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761313:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761322:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761327:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761332:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761336:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761341:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761347:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761351:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761356:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761361:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761366:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761371:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761377:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761382:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761387:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761392:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761397:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761402:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761426:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761431:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761436:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761442:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761447:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761452:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761458:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761463:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761468:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761473:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761478:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761483:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761488:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761493:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761498:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761503:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761508:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761512:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761547:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761554:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761559:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761564:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761569:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761574:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761578:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761583:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761587:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761592:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.761597:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.762045:0:14464:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89f1a955fa00:14464] 1 exiting: rc = 0 00000100:00100000:2.0:1788940685.762573:0:14463:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89f188ed4a00:14463] 0 exiting: rc = 1 00000100:00100000:1.0:1788940685.762896:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762903:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762909:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762914:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762919:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762925:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762940:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762946:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762951:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762957:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762962:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762968:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762974:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762979:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762985:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762990:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.762995:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763001:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763015:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763020:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763025:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763031:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763036:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763041:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763046:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763051:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763056:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763061:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763066:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763295:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763305:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763310:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763314:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763319:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763324:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763329:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763334:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763339:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763344:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763348:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763353:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763365:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763370:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763375:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763380:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763385:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763390:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763394:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763399:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763403:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763408:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763414:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763418:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763423:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763429:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763434:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763439:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763443:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763449:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763453:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763459:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763464:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763468:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.763474:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.763876:0:14466:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff89f18df2f200:14466] 1 exiting: rc = 0 00000100:00100000:3.0:1788940685.764239:0:14465:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff89f18df2fc00:14465] 0 exiting: rc = 1 00000100:00100000:1.0:1788940685.764703:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764709:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764714:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764720:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764725:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764731:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764736:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764742:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764747:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764754:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764759:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764765:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764780:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764786:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764791:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764796:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764802:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764807:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764813:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764819:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764825:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764830:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764835:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764841:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764846:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764852:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764857:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764862:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764868:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764872:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764878:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764883:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764888:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764893:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764898:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764904:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764909:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764914:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764920:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764926:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764931:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764936:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764941:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764945:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764950:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764955:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764959:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764972:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764977:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764982:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764988:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764993:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.764997:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765014:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765028:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765035:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765040:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765046:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765051:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765056:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765061:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765065:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765824:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940685.765837:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.767380:0:14467:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff89f1bf551800:14467] 0 exiting: rc = 1 00000100:00100000:0.0:1788940685.767610:0:14469:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff89f18df2ea00:14469] 2 exiting: rc = 0 00000100:00100000:1.0:1788940685.767851:0:14468:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff89f18df2e000:14468] 1 exiting: rc = 0 00000100:00100000:0.0:1788940685.768481:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768490:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768496:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768502:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768507:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768512:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768560:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768567:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768572:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768577:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768583:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768589:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768595:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768601:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768607:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768635:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768643:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768649:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768655:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768661:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768667:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768673:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768680:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768686:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768691:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768698:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768703:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768709:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768714:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768721:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768727:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768734:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768740:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768746:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768753:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768759:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768765:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768771:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768776:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768798:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768805:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768817:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768822:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768828:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768833:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768839:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768845:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768850:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768855:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768861:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768867:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768872:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768878:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768883:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768889:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768895:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768900:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768906:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768911:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768916:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768921:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768926:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768933:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940685.768938:0:17594:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788940685.778705:0:17594:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940685.778721:0:17594:0:(obd_config.c:958:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788940685.778726:0:17594:0:(genops.c:893:class_export_put()) final put ffff89f1b5c59000/MDS_uuid 00000020:00000080:0.0:1788940685.778730:0:17594:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c59000/MDS_uuid for MDS 00000020:01000000:0.0:1788940685.778737:0:17594:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788940685.778880:0:17594:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788940685.999594:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940686.912721:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940686.912732:0:6732:0:(genops.c:893:class_export_put()) final put ffff89f1bee99800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940686.912775:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee99800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788940686.912849:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bee9f000 for lustre-OST0000 00010000:00010000:0.0:1788940687.021007:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940688.044698:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940688.876777:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940688.876787:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940688.876791:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940688.876802:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1788940688.876810:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940688.876819:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1bee9d800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940688.876842:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738309504:0@lo:400:kworker.0 00000400:00000100:1.0:1788940688.876915:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839738309504 offset 0 length 224: 4 00000100:00100000:1.0:1788940688.877027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6ea00 x1875839738309632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940688.877045:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940688.877049:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940688.877063:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940688.877067:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1788940688.877070:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940688.877074:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1bee98800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940688.877083:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738309632:0@lo:38:kworker.0 00000400:00000100:1.0:1788940688.877107:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839738309632 offset 0 length 520: 4 00000100:00100000:1.0:1788940688.877140:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6ca80 x1875839738309760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940688.877162:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738309760:0@lo:38:kworker.0 00000400:00000100:1.0:1788940688.877179:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839738309760 offset 0 length 520: 4 00010000:00010000:0.0:1788940689.075263:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788940689.250434:0:17748:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940689.260740:0:17748:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788940689.260792:0:17748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.260811:0:17748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.260818:0:17748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.260825:0:17748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.260848:0:17748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940689.260853:0:17748:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940689.260877:0:17748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940689.260889:0:17748:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6ea00 x1875839738309632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940703 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940689.260902:0:17748:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940689.260911:0:17748:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940689.260919:0:17748:0:(import.c:65:import_set_state_nolock()) ffff89f1bee9d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788940689.260934:0:17748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940689.260938:0:17748:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6ea00 x1875839738309632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940703 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940689.260945:0:17748:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940689.260949:0:17748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1788940689.262268:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940689.262278:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.262289:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f188dab800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940689.262293:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.262303:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940689.262310:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940689.262316:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940689.262319:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788940689.262322:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788940689.262361:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.262379:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940689.262418:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.262425:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f188dab800/0x27a633fcdd4bc36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc3d expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.262438:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940689.262439:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940689.262441:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940689.262472:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738309632:0@lo:38:kworker.0 00000100:00100000:2.0:1788940689.262505:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738309888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940689.262608:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940689.264640:0:17748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.264663:0:17748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.264673:0:17748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.264681:0:17748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.270555:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940689.270571:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.270583:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258de00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940689.270597:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940689.270607:0:17748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940689.270608:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940689.270615:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940689.270621:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940689.270624:0:14442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788940689.270660:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.270666:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940689.270687:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.270711:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258de00/0x27a633fcdd4bc0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bc13 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940689.270722:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940689.270723:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940689.270725:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940689.270740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738310016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940689.270793:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738309888 00000100:00100000:2.0:1788940689.270800:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940689.270833:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310016 00000100:00100000:1.0:1788940689.270841:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310016 00000100:00100000:1.0:1788940689.270888:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940689.270896:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875839738310016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788940689.270910:0:14441:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940689 with bad export cookie 178564260921916127 00000100:00100000:0.0:1788940689.272534:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738309888 00010000:00010000:3.0:1788940689.273224:0:17748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940689.273238:0:17748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940689.273246:0:17748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940689.273253:0:17748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940689.273344:0:17748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940689.273352:0:17748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788940689.273358:0:17748:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788940689.273399:0:17748:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788940689.273404:0:17748:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788940689.273409:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940689.273415:0:17748:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940689.273420:0:17748:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffff89f1982e33b0) has no exports 00000020:00080000:3.0:1788940689.273450:0:17748:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffff89f1982e33b0) has no exports 00010000:00010000:0.0:1788940689.274758:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940689.274769:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940689.274780:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940689.274784:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940689.274794:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940689.274802:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940689.274808:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788940689.274810:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788940689.274813:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788940689.274853:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940689.274860:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940689.274894:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940689.274901:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258c800/0x27a633fcdd4bf00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27a633fcdd4bf07 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940689.274913:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940689.274915:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940689.274927:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940689.274942:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940689.274960:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738310144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940689.275024:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940689.275167:0:14440:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788940689.275175:0:14440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788940689.282191:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310144 00000100:00100000:0.0:1788940689.282207:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310144 00000020:01000000:3.0:1788940689.282583:0:17748:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1835c9100 - data ffff89f1bfcef870/ffff89f0829cdc00 00000100:00100000:2.0:1788940689.282657:0:17749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940689.282667:0:17749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875839738309888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940689.282674:0:17749:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940689 with bad export cookie 178564260921916127 00000020:01000000:3.0:1788940689.282725:0:17748:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f18de72200 - data ffff89f18ff02360/ffff89f18db6bc00 00000100:00100000:2.0:1788940689.282766:0:17749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875839738309888:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (20157us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940689.282772:0:17749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940689.282788:0:17749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940689.282792:0:17749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875839738310144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940689.282796:0:17749:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940689 with bad export cookie 178564260921916127 00000100:00100000:2.0:1788940689.282824:0:17749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875839738310144:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (7800us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940689.282829:0:17749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788940689.283012:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788940689.283018:0:3306:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788940689.283022:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788940689.286054:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875839738310016:12345-0@lo:103:ldlm_bl.0 Request processed in 15153us (15249us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788940689.286068:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788940689.289631:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788940689.300485:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.114@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788940689.300492:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788940689.300502:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6e680 x1875839738309504/t0(0) o400->MGC192.168.202.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788940704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940689.300640:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6ed80 x1875839738309888/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940705 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940689.300650:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b4cd2300 x1875839738310016/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940705 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940689.300656:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3305:1875839738309504:0@lo:400:kworker.0 00000100:00100000:0.0:1788940689.300659:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1ae852300 x1875839738310144/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940705 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788940689.300737:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788940689.300740:0:3306:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788940689.300742:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940689.300827:0:3307:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89f1b5c5e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788940689.300842:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738310016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940689.300875:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3307:1875839738310144:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788940689.303825:0:3306:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940689.304766:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1788940689.304780:0:3306:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff89f1b5c5e800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940689.305624:0:3306:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f0821c3100 x1875839738310272/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940689.305676:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3306:1875839738309888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940689.305838:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3304:1875839738310272:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788940689.305889:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839738310272 offset 0 length 520: 4 00100000:10000000:2.0:1788940689.312393:0:17748:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788940689.351449:0:17748:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bc21 00000020:00000080:3.0:1788940689.351460:0:17748:0:(genops.c:893:class_export_put()) final put ffff89f1b489d800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788940689.351486:0:17748:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1af528800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788940689.351490:0:17748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1af528800 2 00000020:01000004:3.0:1788940689.351493:0:17748:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f1af528800 from lustre-OST0000 00000020:00000080:3.0:1788940689.351512:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940689.351739:0:17748:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788940689.351743:0:17748:0:(genops.c:893:class_export_put()) final put ffff89f1b489c000/lustre-OST0000_UUID 00000020:00000080:3.0:1788940689.351747:0:17748:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b489c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788940689.351753:0:17748:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788940689.351798:0:17748:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788940689.351802:0:17748:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788940689.351806:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940689.351811:0:17748:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940689.351818:0:17748:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89f1bee0a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940689.351823:0:17748:0:(genops.c:1561:class_disconnect_exports()) OBD device 14 (ffff89f1b51833b0) has exports, disconnecting them 00000020:00080000:3.0:1788940689.351829:0:17748:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89f1bee0a800), last request at 1788940604 00000020:00000080:3.0:1788940689.351833:0:17748:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bc4b 00000020:00080000:3.0:1788940689.351855:0:17748:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1bee0a800): rc 0 00000020:00000080:3.0:1788940689.351860:0:17748:0:(genops.c:893:class_export_put()) final put ffff89f1bee0a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788940689.352264:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b489d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788940689.352278:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee0a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788940689.358578:0:17748:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788940689.358598:0:17748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940689.358603:0:17748:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940689.358611:0:17748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940689.358803:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940689.358813:0:17748:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788940689.358822:0:17748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1af528800 1 00000020:00000080:0.0:1788940689.358830:0:17748:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bbf0 00000020:00000080:0.0:1788940689.358840:0:17748:0:(genops.c:893:class_export_put()) final put ffff89f1bf53b000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788940689.358846:0:17748:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788940689.358852:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940689.358856:0:17748:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940689.358859:0:17748:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffff89f198018000) has no exports 00000020:00000080:1.0:1788940689.359805:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bee9d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788940689.359818:0:36:0:(genops.c:893:class_export_put()) final put ffff89f188f0f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788940689.359821:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f188f0f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788940689.359837:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788940689.359905:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788940689.373674:0:17748:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940689.373690:0:17748:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788940689.373695:0:17748:0:(genops.c:893:class_export_put()) final put ffff89f18873c800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788940689.373700:0:17748:0:(genops.c:852:class_export_destroy()) destroying export ffff89f18873c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788940689.373706:0:17748:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788940689.373856:0:17748:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f18873d000 00000020:02000400:1.0:1788940689.373906:0:17748:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788940690.092832:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940691.117712:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940692.146884:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940692.541753:0:17898:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940692.573719:0:17898:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788940692.573801:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.573816:0:17898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.573824:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.573830:0:17898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.573858:0:17898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940692.573863:0:17898:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940692.573889:0:17898:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940692.573902:0:17898:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6ca80 x1875839738309760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940703 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940692.573927:0:17898:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940692.573934:0:17898:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940692.573941:0:17898:0:(import.c:65:import_set_state_nolock()) ffff89f1bee98800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788940692.573946:0:17898:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940692.573958:0:17898:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f1b5c6ca80 x1875839738309760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940703 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940692.573965:0:17898:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940692.573969:0:17898:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1788940692.574093:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738309760:0@lo:38:kworker.0 00010000:00010000:1.0:1788940692.574179:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940692.574187:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.574212:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97c00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940692.574215:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.574225:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940692.574232:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940692.574237:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940692.574239:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788940692.574242:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788940692.574255:0:14443:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1b5c5e800 00010000:00010000:1.0:1788940692.574260:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.574266:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97c00/0x27a633fcdd4bd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bd71 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.574277:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940692.574279:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940692.574280:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940692.580484:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580504:0:17898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580512:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580564:0:17898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580584:0:17898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940692.580591:0:17898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580598:0:17898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580603:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580609:0:17898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940692.580620:0:17898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788940692.580624:0:17898:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788940692.580666:0:17898:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788940692.580671:0:17898:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788940692.580676:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940692.580681:0:17898:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940692.580685:0:17898:0:(genops.c:1566:class_disconnect_exports()) OBD device 16 (ffff89f1b51819d8) has no exports 00000020:00080000:3.0:1788940692.580710:0:17898:0:(genops.c:1566:class_disconnect_exports()) OBD device 16 (ffff89f1b51819d8) has no exports 00000020:01000000:3.0:1788940692.582438:0:17898:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1835c9600 - data ffff89f1a9ab0510/ffff89f0823cb000 00000020:01000000:3.0:1788940692.582630:0:17898:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff89f1835c9300 - data ffff89f18ffbd798/ffff89f082729800 00010000:00010000:1.0:1788940692.582991:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940692.583001:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583012:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ebc00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940692.583016:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583042:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940692.583049:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940692.583055:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940692.583057:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788940692.583061:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788940692.583077:0:14443:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1b5c5e800 00010000:00010000:1.0:1788940692.583081:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583088:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812ebc00/0x27a633fcdd4bd40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bd47 expref: -99 pid: 15860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583098:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940692.583102:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583108:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb400 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940692.583111:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583117:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940692.583124:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940692.583138:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940692.583140:0:14443:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940692.583142:0:14443:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940692.583147:0:14443:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1b5c5e800 00010000:00010000:1.0:1788940692.583150:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583156:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812eb400/0x27a633fcdd4bef2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bef9 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940692.583168:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940692.583170:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940692.583171:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940692.583275:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788940692.606154:0:17898:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788940692.634864:0:17898:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bd55 00000020:00000080:2.0:1788940692.634875:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1bee9f800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788940692.634896:0:17898:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1b69b5800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788940692.634912:0:17898:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b69b5800 2 00000020:01000004:2.0:1788940692.634916:0:17898:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89f1b69b5800 from lustre-OST0001 00000020:00000080:2.0:1788940692.634939:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940692.635133:0:17898:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788940692.635138:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1bee98000/lustre-OST0001_UUID 00000020:00000080:2.0:1788940692.635141:0:17898:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee98000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788940692.635148:0:17898:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788940692.635250:0:17898:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f->MGS 00010000:00010000:2.0:1788940692.635267:0:17898:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940692.635279:0:17898:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940692.635285:0:17898:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788940692.635288:0:17898:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788940692.635292:0:17898:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788940692.635306:0:17898:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1b5c5e800 00010000:00010000:2.0:1788940692.635310:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f19258ce00/0x27a633fcdd4bbfe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4bc05 expref: -99 pid: 15137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.635324:0:17898:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940692.635331:0:17898:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940692.635337:0:17898:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940692.635340:0:17898:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788940692.635341:0:17898:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788940692.635350:0:17898:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89f1b5c5e800 00010000:00010000:2.0:1788940692.635352:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad2000/0x27a633fcdd4bae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27a633fcdd4baed expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940692.635377:0:17898:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788940692.635381:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788940692.635384:0:17898:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788940692.635386:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788940692.635390:0:17898:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788940692.635400:0:17898:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89f0821c3100 x1875839738310272/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788940699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788940692.635417:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788940692.635420:0:17898:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1788940692.635501:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f4fd945-1ad9-4c6a-9448-c9b3792aa94f:3304:1875839738310272:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1788940692.635592:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788940692.635600:0:17898:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bad1 00000020:00000080:2.0:1788940692.635604:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1b5c5f000/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f 00000020:01000000:2.0:1788940692.635610:0:17898:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGC192.168.202.114@tcp (flags='') 00000020:00000080:2.0:1788940692.635615:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940692.635619:0:17898:0:(obd_config.c:1048:class_cleanup()) MGC192.168.202.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940692.635622:0:17898:0:(genops.c:1566:class_disconnect_exports()) OBD device 2 (ffff89f1b5c78000) has no exports 00000020:00000080:3.0:1788940692.635715:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee9f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788940692.635725:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b5c5f000/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f for MGC192.168.202.114@tcp 10000000:01000000:1.0:1788940692.644076:0:14451:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788940692.644214:0:17898:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.114@tcp: client import never connected 00000100:00080000:2.0:1788940692.644220:0:17898:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788940692.644224:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788940692.644228:0:17898:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788940692.644230:0:17898:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788940692.644292:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940692.644302:0:17898:0:(obd_config.c:958:class_detach()) detach on obd MGC192.168.202.114@tcp (uuid 0f4fd945-1ad9-4c6a-9448-c9b3792aa94f) 00000020:01000000:2.0:1788940692.644310:0:17898:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788940692.644317:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940692.644322:0:17898:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940692.644331:0:17898:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89f1bee9b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940692.644338:0:17898:0:(genops.c:1561:class_disconnect_exports()) OBD device 17 (ffff89f1b5180000) has exports, disconnecting them 00000020:00080000:2.0:1788940692.644342:0:17898:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89f1bee9b000), last request at 1788940622 00000020:00000080:2.0:1788940692.644347:0:17898:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bd7f 00000020:00080000:2.0:1788940692.644378:0:17898:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff89f1bee9b000): rc 0 00000020:00000080:2.0:1788940692.644384:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1bee9b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788940692.645150:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1b5c5e800 for MGC192.168.202.114@tcp 00000020:00000080:3.0:1788940692.645160:0:36:0:(genops.c:893:class_export_put()) final put ffff89f1b0c11800/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f 00000020:00000080:3.0:1788940692.645164:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b0c11800/0f4fd945-1ad9-4c6a-9448-c9b3792aa94f for MGC192.168.202.114@tcp 00000020:01000000:3.0:1788940692.645171:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.202.114@tcp (0f4fd945-1ad9-4c6a-9448-c9b3792aa94f) 00000020:00000080:3.0:1788940692.645411:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bee9b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788940692.694161:0:17898:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788940692.694170:0:17898:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940692.694174:0:17898:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940692.694181:0:17898:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788940692.694323:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788940692.694511:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1788940692.694656:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff89f1bee98800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1788940692.694807:0:14437:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89f1b50ba000:14437] 0 exiting: rc = 1 00000100:00100000:3.0:1788940692.694890:0:14438:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89f1b50bb000:14438] 1 exiting: rc = 0 00000100:00100000:2.0:1788940692.695100:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.697692:0:14440:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89f1bf63aa00:14440] 1 exiting: rc = 0 00000100:00100000:1.0:1788940692.697808:0:14441:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89f1b50bb400:14441] 2 exiting: rc = 0 00000100:00100000:2.0:1788940692.698488:0:17749:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89f1a955fa00:17749] 3 exiting: rc = 0 00000100:00100000:3.0:1788940692.698731:0:14439:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89f083ec4a00:14439] 0 exiting: rc = 1 00000100:00100000:2.0:1788940692.698935:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698944:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698964:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698971:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698977:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698982:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698987:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698993:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.698998:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699004:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699018:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699023:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699029:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699035:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699041:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699046:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699052:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699059:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699064:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699070:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699076:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699082:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699089:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699094:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699099:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699103:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699130:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699136:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699143:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699148:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699154:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699159:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699164:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699169:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699175:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699179:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699184:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699189:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699195:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699200:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699206:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699212:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699219:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699224:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699230:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699236:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699242:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699248:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699254:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699260:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699267:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699272:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699279:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699284:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699290:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699296:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699303:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699308:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699314:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699320:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699326:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699339:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699345:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.699351:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788940692.700285:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940692.700298:0:17898:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940692.700304:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f08382f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788940692.700309:0:17898:0:(genops.c:852:class_export_destroy()) destroying export ffff89f08382f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788940692.700316:0:17898:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788940692.700364:0:17898:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1b69b5800 1 00000020:00000080:2.0:1788940692.700370:0:17898:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x27a633fcdd4bd39 00000020:00000080:2.0:1788940692.700377:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1b69b0800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788940692.700391:0:17898:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788940692.700396:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940692.700400:0:17898:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940692.700404:0:17898:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffff89f1b6a20000) has no exports 00000020:00000080:3.0:1788940692.701607:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b69b0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788940692.736692:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940692.736708:0:17898:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788940692.736714:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1b69b0000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788940692.736719:0:17898:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1b69b0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788940692.736731:0:17898:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788940692.736936:0:17898:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89f1b69b4800 00000020:01000000:2.0:1788940692.736958:0:17898:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788940692.736963:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940692.736968:0:17898:0:(obd_config.c:1048:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940692.736972:0:17898:0:(genops.c:1566:class_disconnect_exports()) OBD device 12 (ffff89f1b6a219d8) has no exports 00000020:00000080:2.0:1788940692.736993:0:17898:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940692.736999:0:17898:0:(obd_config.c:958:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788940692.737002:0:17898:0:(genops.c:893:class_export_put()) final put ffff89f1bf53a000/OSS_uuid 00000020:00000080:2.0:1788940692.737004:0:17898:0:(genops.c:852:class_export_destroy()) destroying export ffff89f1bf53a000/OSS_uuid for OSS 00000020:01000000:2.0:1788940692.737020:0:17898:0:(genops.c:443:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788940692.737171:0:14450:0:(pinger.c:603:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788940692.737321:0:15140:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff89f1aefaca00:15140] 1 exiting: rc = 0 00000100:00100000:3.0:1788940692.737371:0:15141:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff89f1aefac000:15141] 2 exiting: rc = 0 00000100:00100000:3.0:1788940692.737417:0:16690:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89f083f31200:16690] 3 exiting: rc = 0 00000100:00100000:0.0:1788940692.739379:0:15139:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff89f1b898be00:15139] 0 exiting: rc = 1 00000100:00100000:2.0:1788940692.739623:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739632:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739637:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739657:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739662:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739668:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739673:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739678:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739683:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739688:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739693:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739699:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739704:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739710:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739715:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739723:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739728:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739737:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739744:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739749:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739754:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739759:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739764:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739769:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739775:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739780:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739785:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739792:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739799:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739804:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739809:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739814:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739819:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739824:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739828:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739834:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739839:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739843:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739856:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739861:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739866:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739871:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739876:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739881:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739887:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739892:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739897:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739901:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739907:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739912:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739917:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739922:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739927:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739932:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739937:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739942:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739948:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739953:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739959:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739964:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739969:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739975:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739980:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.739986:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.741720:0:15142:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89f0820be800:15142] 0 exiting: rc = 1 00000100:00100000:3.0:1788940692.741805:0:15143:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89f0820be200:15143] 1 exiting: rc = 0 00000100:00100000:3.0:1788940692.741864:0:16302:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff89f1aed4c200:16302] 2 exiting: rc = 0 00000100:00100000:1.0:1788940692.741958:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741965:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741971:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741976:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741984:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741989:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.741996:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742001:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742059:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742079:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742084:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742089:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742095:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742100:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742105:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742110:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742119:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742126:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742132:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742137:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742142:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742148:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742153:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742158:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742164:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742169:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742175:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742179:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742185:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742189:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742194:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742199:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742203:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742209:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742215:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742220:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742225:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742231:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742236:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742242:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742247:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742252:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742257:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742262:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742275:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742280:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742285:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742291:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742296:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742301:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742306:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742311:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742316:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742320:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742325:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742329:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742334:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742338:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742343:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742348:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742353:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742358:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742364:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940692.742372:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940692.747479:0:15144:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89f1ae81b200:15144] 0 exiting: rc = 1 00000100:00100000:3.0:1788940692.747771:0:15145:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89f1ae81a400:15145] 1 exiting: rc = 0 00000100:00100000:1.0:1788940692.757952:0:15146:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89f1ae81b000:15146] 2 exiting: rc = 0 00000100:00100000:3.0:1788940692.758202:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758226:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758232:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758239:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758244:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758250:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758265:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758272:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758278:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758283:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758288:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758293:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758299:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758304:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758310:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758344:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758352:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758357:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758363:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758368:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758373:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758378:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758384:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758390:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758397:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758402:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758408:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758414:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758421:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758426:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758432:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758438:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758444:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758450:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758456:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758461:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758475:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758481:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758486:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758506:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758514:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758560:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758567:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758573:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758579:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758585:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758591:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758597:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758602:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758608:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758614:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758620:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758625:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758630:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758636:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758642:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758647:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758652:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758658:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758663:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758670:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758676:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758681:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.758687:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.769689:0:15147:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89f1ae81a000:15147] 0 exiting: rc = 1 00000100:00100000:1.0:1788940692.769696:0:15148:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89f1ae81b600:15148] 1 exiting: rc = 0 00000100:00100000:3.0:1788940692.770853:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770861:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770871:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770876:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770882:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770889:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770911:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770916:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770921:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770927:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770933:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770938:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770944:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770959:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770964:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770969:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770975:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770980:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770985:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770990:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.770995:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771000:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771190:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771202:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771207:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771213:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771218:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771223:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771228:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771233:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771238:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771243:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771247:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771252:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771257:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771261:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771266:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771270:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771275:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771280:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771288:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771299:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771304:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771310:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771316:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771321:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771326:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771331:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771336:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771341:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771346:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771350:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771355:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771360:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771364:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771369:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771374:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771379:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771383:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771388:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771393:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771398:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771403:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.771408:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.773786:0:15150:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89f1926e8c00:15150] 1 exiting: rc = 0 00000100:00100000:2.0:1788940692.774091:0:15149:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89f18413d000:15149] 0 exiting: rc = 1 00000100:00100000:3.0:1788940692.774732:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774740:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774746:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774752:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774758:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774764:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774770:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774776:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774781:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774786:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774793:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774825:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774833:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774840:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774847:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774853:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774860:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774866:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774873:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774880:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774886:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774892:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774899:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774918:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774930:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774936:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.774943:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775568:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775579:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775585:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775590:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775597:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775604:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775612:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775619:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775645:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775652:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775659:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775666:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775672:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775678:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775686:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775692:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775699:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775705:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775712:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775727:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775746:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775753:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775760:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775766:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775773:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775779:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775786:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775792:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775799:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775806:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775812:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775819:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775837:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775844:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775850:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775857:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940692.775863:0:17898:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788940692.804118:0:17898:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788940714.259708:0:18517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788940723.663097:0:18977:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788940723.663103:0:18977:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788940723.664593:0:18977:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1bee49000 00000020:01000004:3.0:1788940723.664623:0:18977:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788940723.664631:0:18977:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788940723.664645:0:18977:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89f1b6a233b0) 00000020:00000080:3.0:1788940723.664658:0:18977:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940723.689842:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940723.692499:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788940723.692901:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 535: rc = 0 00100000:10000000:2.0:1788940723.693197:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788940723.694915:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 535: rc = 0 00100000:10000000:2.0:1788940723.695117:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 535: rc = 0 00100000:10000000:2.0:1788940723.695220:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 535: rc = 0 00100000:10000000:2.0:1788940723.695603:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 535: rc = 0 00100000:10000000:2.0:1788940723.695708:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 535: rc = 0 00100000:10000000:2.0:1788940723.696196:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 537: rc = 0 00100000:10000000:2.0:1788940723.698104:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1788940723.698211:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:1.0:1788940723.700802:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 674: rc = 0 00100000:10000000:1.0:1788940723.701632:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.702088:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.702365:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.702676:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 674: rc = 0 00100000:10000000:1.0:1788940723.702939:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 674: rc = 0 00100000:10000000:1.0:1788940723.703205:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 674: rc = 0 00100000:10000000:1.0:1788940723.703464:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 674: rc = 0 00100000:10000000:1.0:1788940723.703755:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.704018:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.704261:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 674: rc = 0 00100000:10000000:1.0:1788940723.706448:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 674: rc = 0 00100000:10000000:1.0:1788940723.707181:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 696: rc = 0 00100000:10000000:1.0:1788940723.712027:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 696: rc = 0 00100000:10000000:1.0:1788940723.712452:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 696: rc = 0 00100000:10000000:1.0:1788940723.713052:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 696: rc = 0 00100000:10000000:1.0:1788940723.713365:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 696: rc = 0 00100000:10000000:1.0:1788940723.713698:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 696: rc = 0 00100000:10000000:1.0:1788940723.714138:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 696: rc = 0 00100000:10000000:1.0:1788940723.714466:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 696: rc = 0 00100000:10000000:1.0:1788940723.714928:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 696: rc = 0 00100000:10000000:1.0:1788940723.715256:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 696: rc = 0 00100000:10000000:1.0:1788940723.715801:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 696: rc = 0 00100000:10000000:1.0:1788940723.716127:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 696: rc = 0 00100000:10000000:1.0:1788940723.716456:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 696: rc = 0 00100000:10000000:1.0:1788940723.717063:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 696: rc = 0 00100000:10000000:1.0:1788940723.717396:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 696: rc = 0 00100000:10000000:1.0:1788940723.717918:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 696: rc = 0 00100000:10000000:1.0:1788940723.718331:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 696: rc = 0 00100000:10000000:1.0:1788940723.718684:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 696: rc = 0 00100000:10000000:1.0:1788940723.719073:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 696: rc = 0 00100000:10000000:1.0:1788940723.719406:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 696: rc = 0 00100000:10000000:1.0:1788940723.719873:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 696: rc = 0 00100000:10000000:1.0:1788940723.720209:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 696: rc = 0 00100000:10000000:1.0:1788940723.720707:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 696: rc = 0 00100000:10000000:1.0:1788940723.721123:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 696: rc = 0 00100000:10000000:1.0:1788940723.721463:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 696: rc = 0 00100000:10000000:1.0:1788940723.722057:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 696: rc = 0 00100000:10000000:1.0:1788940723.722385:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 696: rc = 0 00100000:10000000:1.0:1788940723.722628:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 696: rc = 0 00100000:10000000:1.0:1788940723.722915:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 696: rc = 0 00100000:10000000:1.0:1788940723.723210:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 696: rc = 0 00100000:10000000:1.0:1788940723.723508:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 696: rc = 0 00100000:10000000:1.0:1788940723.727707:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 696: rc = 0 00100000:10000000:1.0:1788940723.728244:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 41: rc = 0 00100000:10000000:1.0:1788940723.728909:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788940723.729097:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:1.0:1788940723.729236:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788940723.729385:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:1.0:1788940723.729707:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788940723.729854:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:1.0:1788940723.730596:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788940723.730650:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 540: rc = 0 00100000:10000000:1.0:1788940723.730934:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788940723.731098:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 540: rc = 0 00100000:10000000:1.0:1788940723.731302:0:18977:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788940723.731373:0:18977:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 540: rc = 0 00000020:00000080:1.0:1788940723.731677:0:18977:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788940723.731685:0:18977:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788940723.731696:0:18977:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c217 00000020:01000004:1.0:1788940723.731704:0:18977:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788940723.731710:0:18977:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788940723.732029:0:18977:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1bee49000 from MGS 00000020:01000004:1.0:1788940723.732035:0:18977:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788940723.732045:0:18977:0:(genops.c:415:class_newdev()) Allocate new device MGS (ffff89f1b51833b0) 00000020:00000080:1.0:1788940723.732057:0:18977:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788940723.732115:0:18977:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1bee49000 from MGS, refs=2 00080000:01000000:1.0:1788940723.732119:0:18977:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940723.732124:0:18977:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c225 00000100:00100000:1.0:1788940723.732221:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788940723.732358:0:18977:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788940723.732364:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788940723.733066:0:18977:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788940723.733072:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788940723.733918:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940723.734145:0:18977:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788940723.734151:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788940723.734815:0:18977:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788940723.734823:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788940723.735276:0:18977:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788940723.735283:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788940723.736061:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940723.736065:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940723.736067:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940723.736444:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940723.736447:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940723.736449:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940723.737145:0:18977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788940723.743385:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788940723.751069:0:18977:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788940723.751089:0:18977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788940723.751091:0:18977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788940723.760544:0:18987:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788940723.760832:0:18977:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788940723.760947:0:18977:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788940723.761648:0:18977:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788940723.762232:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940723.762846:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788940723.762853:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788940723.764330:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788940723.764341:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788940723.764927:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788940723.764934:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788940723.766089:0:18977:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788940723.766113:0:18977:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.114@tcp' 00000020:01000004:1.0:1788940723.766115:0:18977:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788940723.766145:0:18977:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.114@tcp (typ=mgc) 00000020:00000080:1.0:1788940723.766157:0:18977:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.114@tcp (ffff89f1b5184d88) 00000020:00000080:1.0:1788940723.766172:0:18977:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788940723.766313:0:18977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f08382e800@MGC192.168.202.114@tcp: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940723.766461:0:18977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.114@tcp-0 is initialized 00000040:01000000:1.0:1788940723.766467:0:18977:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788940723.766609:0:18992:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788940723.767170:0:18993:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788940723.767222:0:18977:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.114@tcp (uuid c7833fd5-ba21-4794-9436-ab89d07c3023) 00000020:00000080:2.0:1788940723.767237:0:18977:0:(genops.c:1393:class_connect()) connect: client c7833fd5-ba21-4794-9436-ab89d07c3023, cookie 0x27a633fcdd4c233 00000100:00080000:2.0:1788940723.767312:0:18977:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940723.767319:0:18977:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff89f08382e800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940723.767353:0:18977:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd3b80 x1875839738310400/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940723.767411:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7833fd5-ba21-4794-9436-ab89d07c3023:3304:1875839738310400:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788940723.767478:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.767595:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310400 00000100:00100000:0.0:1788940723.767603:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310400 00000100:00100000:0.0:1788940723.767636:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940723.767644:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875839738310400:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788940723.767666:0:18989:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c7833fd5-ba21-4794-9436-ab89d07c3023@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:0.0:1788940723.767689:0:18989:0:(genops.c:1393:class_connect()) connect: client c7833fd5-ba21-4794-9436-ab89d07c3023, cookie 0x27a633fcdd4c23a 00000100:00080000:0.0:1788940723.767827:0:18989:0:(import.c:65:import_set_state_nolock()) ffff89f081136800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788940723.767909:0:18977:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import c7833fd5-ba21-4794-9436-ab89d07c3023->MGS 00000020:01000004:2.0:1788940723.767926:0:18977:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788940723.767931:0:18977:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788940723.767941:0:18977:0:(genops.c:415:class_newdev()) Allocate new device MDS (ffff89f19801b3b0) 00000020:00000080:2.0:1788940723.767951:0:18977:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788940723.768212:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+5:3304:x1875839738310400:12345-0@lo:250:mount.lustre.0 Request processed in 566us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.768221:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940723.788037:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940723.788222:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940723.788228:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788940723.789875:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788940723.789892:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.114@tcp: connect to target with instance 0 00000100:00080000:1.0:1788940723.789902:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788940723.789907:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788940723.789912:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f08382e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788940723.789916:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788940723.789932:0:3304:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788940723.789941:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7833fd5-ba21-4794-9436-ab89d07c3023:3304:1875839738310400:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788940723.798383:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788940723.798397:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788940723.799731:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940723.799741:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788940723.801930:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.802128:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788940723.802134:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788940723.805790:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788940723.805801:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788940723.845962:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.846187:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788940723.846194:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788940723.847234:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788940723.847362:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788940723.848448:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.848806:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788940723.848812:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788940723.849212:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788940723.849218:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788940723.850032:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.850173:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788940723.850179:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788940723.850842:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788940723.850850:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788940723.851383:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.851669:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788940723.851675:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788940723.852167:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788940723.852175:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788940723.865747:0:18977:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940723.865952:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788940723.865959:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788940723.867733:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788940723.867746:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788940723.868706:0:18977:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940723.868716:0:18977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788940723.869488:0:18977:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788940723.869514:0:18977:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788940723.869655:0:18977:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788940723.869785:0:18977:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940723.869819:0:18977:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788940723.869826:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940723.869828:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940723.869829:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940723.869830:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940723.869831:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940723.869833:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940723.869834:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940723.869836:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940723.869837:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940723.869839:0:18977:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940723.869841:0:18977:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788940723.869843:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940723.869844:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940723.869845:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940723.869846:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940723.869847:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940723.869848:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940723.869849:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940723.869850:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940723.869851:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940723.869852:0:18977:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940723.869877:0:18977:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788940723.869897:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940723.869971:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.870073:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.870131:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310528 00000100:00100000:2.0:1788940723.870138:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310528 00000100:00100000:2.0:1788940723.870223:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940723.870233:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+5:18977:x1875839738310528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940723.870296:0:18991:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788940723.870299:0:18991:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788940723.870302:0:18991:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788940723.870749:0:19012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788940723.871101:0:18991:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1788940723.872150:0:19013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788940723.872156:0:19013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788940723.872159:0:19013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788940723.872193:0:19013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788940723.872647:0:18991:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788940723.872657:0:18991:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788940723.876837:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+5:18977:x1875839738310528:12345-0@lo:253:mount.lustre.0 Request processed in 6596us (6857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.876854:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940723.876941:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940723.876956:0:18977:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788940723.876959:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940723.876961:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940723.876962:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940723.876964:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940723.876965:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940723.876967:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940723.876980:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940723.876982:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940723.876984:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940723.876985:0:18977:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940723.877005:0:18977:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1bee49000 from lustre-MDT0000 10000000:01000000:3.0:1788940723.877033:0:18977:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788940723.877037:0:18977:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940723.877041:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89f1b5184d88 10000000:01000000:3.0:1788940723.877048:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940723.877057:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89f1b5184d88 from 1 10000000:01000000:3.0:1788940723.877060:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788940723.877096:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.877107:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.877117:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.877136:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940723.877171:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.877253:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.877377:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310656 00000100:00100000:0.0:1788940723.877384:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310656 00000100:00100000:0.0:1788940723.877468:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940723.877478:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+5:18977:x1875839738310656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940723.877490:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.877505:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea200/0x27a633fcdd4c24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c248 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.877674:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea200/0x27a633fcdd4c24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c248 expref: 6 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.877685:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea200/0x27a633fcdd4c24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c248 expref: 6 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.877694:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea200, rc 0) 00000100:00100000:0.0:1788940723.877783:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+6:18977:x1875839738310656:12345-0@lo:101:mount.lustre.0 Request processed in 307us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.877791:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940723.877935:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940723.877948:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.877956:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.878002:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940723.878041:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.878106:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.878141:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310784 00000100:00100000:0.0:1788940723.878145:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310784 00000100:00100000:0.0:1788940723.878179:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940723.878186:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+6:18977:x1875839738310784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940723.878634:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+6:18977:x1875839738310784:12345-0@lo:501:mount.lustre.0 Request processed in 447us (591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940723.878641:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940723.878801:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788940723.878825:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788940723.878874:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.878884:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940723.878891:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1bee49000 10000000:01000000:3.0:1788940723.878896:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940723.878900:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89f1bee49000 10000000:01000000:3.0:1788940723.878902:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788940723.878905:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89f1bee49000 from 1 10000000:01000000:3.0:1788940723.878908:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788940723.878926:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.878933:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.878942:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.878955:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940723.878979:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.879003:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.879051:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738310912 00000100:00100000:2.0:1788940723.879055:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738310912 00000100:00100000:2.0:1788940723.879112:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940723.879119:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+6:18977:x1875839738310912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940723.879127:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940723.879139:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520c00/0x27a633fcdd4c25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c256 expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.879155:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520c00/0x27a633fcdd4c25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c256 expref: 7 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.879164:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520c00/0x27a633fcdd4c25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c256 expref: 7 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.879171:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520c00, rc 0) 00000100:00100000:2.0:1788940723.879204:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+7:18977:x1875839738310912:12345-0@lo:101:mount.lustre.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.879209:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940723.879300:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738310912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940723.879321:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c25d expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.879329:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c25d expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940723.879341:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788940723.879354:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c25d expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.879360:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96600/0x27a633fcdd4c256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c25d expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940723.879366:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940723.879369:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940723.879373:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89f1bee49000 10000000:01000000:3.0:1788940723.879375:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788940723.879378:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788940723.879380:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940723.879392:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.879399:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.879406:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.879416:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940723.879438:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.879675:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940723.879705:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311040 00000100:00100000:1.0:1788940723.879709:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311040 00000100:00100000:1.0:1788940723.879790:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940723.879796:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+7:18977:x1875839738311040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940723.879803:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940723.879811:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258d200/0x27a633fcdd4c26b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c264 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.879825:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258d200/0x27a633fcdd4c26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c264 expref: 8 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.879834:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258d200/0x27a633fcdd4c26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c264 expref: 8 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.879846:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258d200, rc 0) 00000100:00100000:1.0:1788940723.879880:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+8:18977:x1875839738311040:12345-0@lo:101:mount.lustre.0 Request processed in 84us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.879886:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940723.879945:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940723.879955:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c26b expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.879963:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c26b expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.879996:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940723.880017:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.880034:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940723.880072:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311168 00000100:00100000:1.0:1788940723.880076:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311168 00000100:00100000:1.0:1788940723.880090:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940723.880095:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+8:18977:x1875839738311168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940723.880550:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:18977:x1875839738311168:12345-0@lo:501:mount.lustre.0 Request processed in 422us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.880558:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940723.880690:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940723.880790:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940723.880828:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.880879:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940723.880914:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311296 00000100:00100000:1.0:1788940723.880918:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311296 00000100:00100000:1.0:1788940723.880977:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940723.880984:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:18977:x1875839738311296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940723.881361:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:18977:x1875839738311296:12345-0@lo:503:mount.lustre.0 Request processed in 376us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.881369:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940723.881442:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940723.881850:0:19014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19014:1875839738311424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940723.881885:0:19014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.882206:0:19014:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940723.882282:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311424 00000100:00100000:1.0:1788940723.882288:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311424 00000100:00100000:1.0:1788940723.882314:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940723.882321:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:19014:x1875839738311424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940723.882604:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:19014:x1875839738311424:12345-0@lo:502:llog_process_th.0 Request processed in 281us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.882611:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940723.882818:0:19014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19014:1875839738311424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940723.882843:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940723.882854:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940723.882856:0:19014:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940723.882861:0:19014:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788940723.882865:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940723.882879:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89f1b6a24d88) 00000020:00000080:3.0:1788940723.882903:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788940723.882910:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788940723.882982:0:19014:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788940723.882990:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c279 00000020:00000080:3.0:1788940723.883194:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940723.883199:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940723.883202:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940723.883204:0:19014:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940723.883207:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940723.883211:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940723.883212:0:19014:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788940723.883215:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940723.883222:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (ffff89f1b6a219d8) 00000020:00000080:3.0:1788940723.883232:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788940723.883236:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788940723.883238:0:19014:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788940723.883241:0:19014:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788940723.883246:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940723.883305:0:19014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1bee49000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788940723.883318:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (ffff89f1b6a20000) 00000020:00000080:3.0:1788940723.883325:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788940723.883373:0:19014:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788940723.883378:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4c28e 00000020:00000080:3.0:1788940723.883474:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788940723.883480:0:19014:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788940723.883485:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27a633fcdd4c295 00080000:01000000:3.0:1788940723.883490:0:19014:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788940723.883493:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c29c 00010000:00010000:2.0:1788940723.956796:0:19014:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788940723.957257:0:19014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1788940723.958843:0:19014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788940723.959312:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (ffff89f19801cd88) 00000020:00000080:2.0:1788940723.959330:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788940723.959387:0:19014:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788940723.959396:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c2aa 00000020:00000080:2.0:1788940723.961064:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788940723.964139:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27a633fcdd4c2b1 00000020:00000080:2.0:1788940723.973314:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788940723.973332:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940723.973341:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940723.973343:0:19014:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788940723.973347:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940723.973352:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940723.973354:0:19014:0:(obd_config.c:1662:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788940723.973359:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788940723.973402:0:19014:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788940723.973415:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940723.973419:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940723.973420:0:19014:0:(obd_config.c:1662:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788940723.973423:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788940723.973425:0:19014:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788940723.973427:0:19014:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940723.973429:0:19014:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940723.973430:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788940723.973433:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940723.973434:0:19014:0:(obd_config.c:1662:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788940723.973437:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788940723.973441:0:19014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788940723.973444:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940723.973445:0:19014:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788940723.973447:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788940723.973453:0:19014:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:2.0:1788940723.973479:0:19014:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788940723.973482:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940723.973507:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89f198018000) 00000020:00000080:2.0:1788940723.973543:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788940723.973549:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788940723.973614:0:19014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788940723.973619:0:19014:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788940723.973626:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c2bf 00010000:00080000:2.0:1788940723.973848:0:19014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b897f000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:2.0:1788940723.974156:0:19014:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788940723.975832:0:19014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788940723.975909:0:19014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788940723.979355:0:19014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940723.979428:0:19014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788940723.979499:0:19014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788940723.981073:0:19018:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788940723.981080:0:19018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940723.981834:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940723.981847:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940723.981879:0:19014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940723.981898:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4c2c6 00000100:00080000:1.0:1788940723.981910:0:19014:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940723.981917:0:19014:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f1b897f000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940723.981956:0:19014:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6ea00 x1875839738311552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940723.982046:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738311552:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788940723.982103:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738311552 offset 0 length 520: 4 00000100:00080000:1.0:1788940723.982180:0:19014:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788940723.982248:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940723.982253:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.982254:0:19014:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788940723.982257:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940723.982270:0:19014:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788940723.982272:0:19014:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940723.982273:0:19014:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940723.982275:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940723.982277:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.982279:0:19014:0:(obd_config.c:1662:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940723.982282:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940723.982286:0:19014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940723.982289:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.982291:0:19014:0:(obd_config.c:1662:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788940723.982293:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940723.982297:0:19014:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788940723.982318:0:19014:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940723.982320:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940723.982332:0:19014:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89f1b5180000) 00000020:00000080:1.0:1788940723.982345:0:19014:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788940723.982350:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940723.982417:0:19014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788940723.982423:0:19014:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788940723.982435:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27a633fcdd4c2d4 00010000:00080000:1.0:1788940723.982466:0:19014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f192366800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940723.982886:0:19014:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788940723.983056:0:19014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940723.983080:0:19014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940723.986394:0:19014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940723.986473:0:19014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788940723.986592:0:19014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788940723.988346:0:19020:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788940723.988353:0:19020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788940723.989237:0:19014:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940723.989251:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788940723.989295:0:19014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788940723.989314:0:19014:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4c2db 00000100:00080000:0.0:1788940723.989333:0:19014:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940723.989340:0:19014:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940723.989377:0:19014:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ae851f80 x1875839738311680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940723.989443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738311680:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788940723.989500:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738311680 offset 0 length 520: 4 00000100:00080000:0.0:1788940723.989836:0:19014:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788940723.989990:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940723.989994:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940723.989996:0:19014:0:(obd_config.c:1662:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788940723.990000:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940723.990004:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940723.990006:0:19014:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940723.990009:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940723.990011:0:19014:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788940723.990013:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940723.990016:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940723.990017:0:19014:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788940723.990019:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940723.990022:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940723.990023:0:19014:0:(obd_config.c:1662:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940723.990027:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788940723.990058:0:19014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19014:1875839738311808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940723.990108:0:19014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.990141:0:19014:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940723.990195:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311808 00000100:00100000:3.0:1788940723.990202:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311808 00000100:00100000:3.0:1788940723.990250:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940723.990259:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:19014:x1875839738311808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940723.990547:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+9:19014:x1875839738311808:12345-0@lo:502:llog_process_th.0 Request processed in 259us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.990555:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940723.990619:0:19014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19014:1875839738311808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940723.990832:0:19014:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940723.990839:0:19014:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940723.990841:0:19014:0:(obd_config.c:1662:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940723.990845:0:19014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788940723.990979:0:18977:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788940723.990995:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940723.991010:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c26b expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991021:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96e00/0x27a633fcdd4c264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c26b expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940723.991056:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1bee49000 from 1 10000000:01000000:0.0:1788940723.991058:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940723.991088:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991097:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991106:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.991122:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940723.991152:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.991176:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738311936 00000100:00100000:0.0:1788940723.991180:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738311936 00000100:00100000:0.0:1788940723.991211:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940723.991218:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+9:18977:x1875839738311936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940723.991227:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.991240:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c2e2 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991259:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 10 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991280:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 10 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991288:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea000, rc 0) 00000100:00100000:0.0:1788940723.991320:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+10:18977:x1875839738311936:12345-0@lo:101:mount.lustre.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.991326:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940723.991358:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.991372:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738311936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940723.991384:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.991393:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.992091:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312064:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788940723.992133:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.992163:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312064 00000100:00100000:0.0:1788940723.992167:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312064 00000100:00100000:0.0:1788940723.992190:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940723.992195:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+10:18977:x1875839738312064:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788940723.992209:0:18989:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788940723.992214:0:18989:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788940723.992278:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+10:18977:x1875839738312064:12345-0@lo:256:mount.lustre.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.992284:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940723.992317:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.992331:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312064:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788940723.992934:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940723.992950:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.992973:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940723.992999:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bee49000 from 1 10000000:01000000:0.0:1788940723.993002:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940723.993030:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993038:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993047:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.993062:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940723.993096:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.993117:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312192 00000100:00100000:0.0:1788940723.993121:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312192 00000100:00100000:0.0:1788940723.993144:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940723.993150:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+10:18977:x1875839738312192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940723.993158:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.993168:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c2f0 expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993184:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993194:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993209:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ea400, rc 0) 00000100:00100000:0.0:1788940723.993234:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312192:12345-0@lo:101:mount.lustre.0 Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.993240:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940723.993286:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.993300:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940723.993312:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.993320:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.993370:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940723.993394:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.993414:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312320 00000100:00100000:0.0:1788940723.993418:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312320 00000100:00100000:0.0:1788940723.993439:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940723.993445:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940723.993823:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312320:12345-0@lo:501:mount.lustre.0 Request processed in 378us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.993831:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940723.993861:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190120480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.993874:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940723.993899:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940723.993942:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.993961:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312448 00000100:00100000:0.0:1788940723.993965:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312448 00000100:00100000:0.0:1788940723.993984:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940723.993990:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940723.994110:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312448:12345-0@lo:503:mount.lustre.0 Request processed in 120us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.994116:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940723.994148:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190120480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.994161:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940723.995318:0:19022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19022:1875839738312576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940723.995373:0:19022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.995443:0:19022:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.995484:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312576 00000100:00100000:0.0:1788940723.995490:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312576 00000100:00100000:0.0:1788940723.995730:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940723.995741:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:19022:x1875839738312576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940723.995966:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:19022:x1875839738312576:12345-0@lo:502:llog_process_th.0 Request processed in 227us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.995973:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940723.996049:0:19022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19022:1875839738312576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940723.996078:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940723.996088:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.996090:0:19022:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940723.996096:0:19022:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1bee49000 00000020:00000080:1.0:1788940723.996099:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940723.996108:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940723.996110:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.996112:0:19022:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788940723.996114:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940723.996116:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.996117:0:19022:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940723.996120:0:19022:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1bee49000 00000020:00000080:1.0:1788940723.996122:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940723.996171:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940723.996174:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.996176:0:19022:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788940723.996178:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940723.996180:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.996182:0:19022:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940723.996185:0:19022:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1bee49000 00000020:00000080:1.0:1788940723.996187:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940723.996232:0:19022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19022:1875839738312704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940723.996278:0:19022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.996505:0:19022:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.996775:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312704 00000100:00100000:2.0:1788940723.996781:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312704 00000100:00100000:2.0:1788940723.996813:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940723.996819:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+11:19022:x1875839738312704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940723.996961:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+11:19022:x1875839738312704:12345-0@lo:502:llog_process_th.0 Request processed in 141us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.996968:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940723.997074:0:19022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19022:1875839738312704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940723.997097:0:19022:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940723.997103:0:19022:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940723.997105:0:19022:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788940723.997108:0:19022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788940723.997258:0:18977:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788940723.997286:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940723.997307:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997318:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940723.997377:0:18977:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788940723.997380:0:18977:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1bee49000 10000000:01000000:2.0:1788940723.997382:0:18977:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1bee49000 10000000:01000000:2.0:1788940723.997386:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940723.997391:0:18977:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1bee49000 from 1 10000000:01000000:2.0:1788940723.997394:0:18977:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940723.997424:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997432:0:18977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997443:0:18977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.997458:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940723.997487:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.997509:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312832 00000100:00100000:2.0:1788940723.997513:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312832 00000100:00100000:2.0:1788940723.997555:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940723.997560:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738312832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940723.997569:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940723.997579:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520400/0x27a633fcdd4c305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c2fe expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997599:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520400/0x27a633fcdd4c305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c2fe expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997622:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520400/0x27a633fcdd4c305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c2fe expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997631:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520400, rc 0) 00000100:00100000:2.0:1788940723.997755:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738312832:12345-0@lo:101:mount.lustre.0 Request processed in 193us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.997762:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940723.997796:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.997809:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940723.997821:0:18977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c305 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.997830:0:18977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c305 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.997871:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940723.997893:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.997911:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738312960 00000100:00100000:2.0:1788940723.997914:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738312960 00000100:00100000:2.0:1788940723.997928:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940723.997933:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738312960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940723.998124:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738312960:12345-0@lo:501:mount.lustre.0 Request processed in 190us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.998132:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940723.998154:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.998168:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738312960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940723.998202:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738313088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940723.998236:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.998255:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313088 00000100:00100000:2.0:1788940723.998259:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313088 00000100:00100000:2.0:1788940723.998545:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940723.998552:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738313088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940723.998735:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738313088:12345-0@lo:503:mount.lustre.0 Request processed in 183us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.998743:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940723.998779:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.998792:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738313088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940724.000994:0:19023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19023:1875839738313216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940724.001070:0:19023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940724.001113:0:19023:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940724.002388:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313216 00000100:00100000:2.0:1788940724.002400:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313216 00000100:00100000:2.0:1788940724.002458:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940724.002467:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19023:x1875839738313216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940724.002782:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19023:x1875839738313216:12345-0@lo:502:llog_process_th.0 Request processed in 315us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940724.002791:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940724.003041:0:19023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19023:1875839738313216:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788940724.003100:0:19023:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788940724.003115:0:19023:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89f1980199d8) 00000020:00000080:2.0:1788940724.003138:0:19023:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788940724.003215:0:19023:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1bee49000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940724.003220:0:19023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1bee49000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940724.003222:0:19023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1bee49000 4 00010000:00080000:2.0:1788940724.003257:0:19023:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1baa2b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:2.0:1788940724.009016:0:19023:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788940724.009210:0:19023:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788940724.009245:0:19023:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940724.009256:0:19023:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27a633fcdd4c313 00000100:00080000:2.0:1788940724.009786:0:19023:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940724.009795:0:19023:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89f1baa2b000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940724.009830:0:19023:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd0700 x1875839738313344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940724.009859:0:19023:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940724.009940:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738313344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940724.010011:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940724.018893:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313344 00000100:00100000:0.0:1788940724.018907:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313344 00000100:00100000:0.0:1788940724.018952:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940724.018961:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738313344:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940724.019055:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875839738313344:12345-0@lo:38:llog_process_th.0 Request processed in 94us (9043us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788940724.019063:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940724.019108:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940724.019116:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1baa2b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940724.019125:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788940724.019130:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738313344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940724.023320:0:19023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19023:1875839738313472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940724.023425:0:19023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940724.023470:0:19023:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940724.023493:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313472 00000100:00100000:0.0:1788940724.023501:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313472 00000100:00100000:0.0:1788940724.023573:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940724.023583:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19023:x1875839738313472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940724.023830:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19023:x1875839738313472:12345-0@lo:502:llog_process_th.0 Request processed in 248us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940724.023838:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940724.023894:0:19023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7833fd5-ba21-4794-9436-ab89d07c3023:19023:1875839738313472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788940724.023926:0:19023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788940724.025405:0:18977:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788940724.025439:0:18977:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940724.025465:0:18977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c305 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.025477:0:18977:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181521600/0x27a633fcdd4c2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c305 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940724.025548:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940724.025551:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940724.025552:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940724.025553:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940724.025554:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940724.025555:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940724.025556:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940724.025558:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940724.025559:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940724.025560:0:18977:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940724.025564:0:18977:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788940724.025566:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940724.025567:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940724.025568:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940724.025573:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940724.025574:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940724.025575:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940724.025576:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940724.025577:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940724.025577:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940724.025578:0:18977:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940724.025603:0:18977:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940724.025623:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738313600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940724.025692:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940724.025731:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f19103d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940724.028346:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313600 00000100:00100000:3.0:1788940724.028360:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313600 00000100:00100000:3.0:1788940724.028420:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940724.028429:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18977:x1875839738313600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940724.028461:0:18989:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940724.028473:0:18989:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788940724.096976:0:18989:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940724.097029:0:18989:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788940724.097108:0:19012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940724.097113:0:19012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940724.097136:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.097153:0:19012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.097162:0:19012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.097202:0:19012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.097216:0:19012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 12 pid: 18991 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940724.097230:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738313728:0@lo:104: 00000100:00100000:2.0:1788940724.097369:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940724.097417:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186823300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940724.097501:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313728 00000100:00100000:0.0:1788940724.097508:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313728 00000100:00100000:0.0:1788940724.097587:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940724.097598:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738313728:12345-0@lo:104: 00010000:00010000:0.0:1788940724.097620:0:18979:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097677:0:18979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940724.097684:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738313728:12345-0@lo:104: Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940724.097706:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788940724.097738:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940724.097744:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097752:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb800 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:0.0:1788940724.097756:0:18985:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097765:0:18985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940724.097772:0:18985:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940724.097777:0:18985:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940724.097801:0:18985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097807:0:18985:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940724.097824:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097831:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812eb800/0x27a633fcdd4c2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2e9 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.097844:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940724.097846:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940724.097847:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940724.097871:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738313856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940724.097904:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940724.097956:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313856 00000100:00100000:0.0:1788940724.097960:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313856 00010000:00010000:0.0:1788940724.097976:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 13 pid: 18991 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940724.097996:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940724.098002:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+13:3305:x1875839738313856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940724.098011:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940724.098016:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 13 pid: 18991 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098025:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 13 pid: 18991 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098039:0:18981:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098046:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940724.098057:0:18981:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000944885s 00010000:00010000:0.0:1788940724.098062:0:18981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098069:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098076:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098093:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098099:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940724.098103:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098111:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098120:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.098129:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940724.098159:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+13:3305:x1875839738313856:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940724.098165:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940724.098199:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738313856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940724.098556:0:19012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ea000/0x27a633fcdd4c2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c2e2 expref: 12 pid: 18991 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940724.098567:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738313728:0@lo:104: 00010000:00010000:1.0:1788940724.098581:0:19012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.098588:0:19012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.098594:0:19012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.098599:0:19012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c31a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940724.108439:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18977:x1875839738313600:12345-0@lo:253:mount.lustre.0 Request processed in 80002us (82738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940724.108470:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940724.108609:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:18977:1875839738313600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940724.108700:0:18977:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788940724.108703:0:18977:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940724.108705:0:18977:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788940724.108721:0:18977:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940724.108723:0:18977:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940724.108724:0:18977:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940724.108725:0:18977:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940724.108727:0:18977:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940724.108728:0:18977:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788940724.108730:0:18977:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940724.108732:0:18977:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788940724.108748:0:18977:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788940724.114338:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940724.114507:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940724.114838:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940724.114988:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940724.115289:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940724.115450:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940724.117455:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940724.117956:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940724.118231:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940724.118769:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940724.119051:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940724.119201:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788940724.155797:0:18977:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:3.0:1788940724.156119:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788940724.156544:0:19035:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788940724.156599:0:19035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940724.162687:0:19035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788940724.162766:0:19035:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788940724.162779:0:19035:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788940724.163675:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788940724.163874:0:18977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788940724.164385:0:19034:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:1.0:1788940724.164390:0:19034:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000004:00000080:0.0:1788940724.164858:0:18977:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788940724.164869:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788940724.165047:0:18977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940724.172205:0:18977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788940724.173507:0:18977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788940724.173829:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788940724.174413:0:18977:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788940724.176421:0:18977:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788940724.195895:0:18977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788940724.230994:0:18977:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788940724.231032:0:18977:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff98fc414fb988 00100000:10000000:0.0:1788940724.231041:0:18977:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788940724.231962:0:18977:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788940724.231977:0:18977:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788940724.231991:0:18977:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788940724.232012:0:18977:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788940724.788186:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940725.101130:0:19030:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788940725.101143:0:19030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940725.101637:0:19030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788940725.101646:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1788940725.548634:0:18993:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940725.548657:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1bee49000 from 9 10000000:01000000:0.0:1788940725.548662:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940725.548722:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.548735:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.548747:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940725.548774:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738313984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.548844:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940725.548931:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b89a3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940725.549145:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738313984 00000100:00100000:3.0:1788940725.549154:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738313984 00000100:00100000:3.0:1788940725.549212:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940725.549221:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18993:x1875839738313984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940725.549259:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940725.549277:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c321 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.549303:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.549315:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.549335:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97800, rc 0) 00000100:00100000:3.0:1788940725.549389:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738313984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940725.549395:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940725.549567:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738313984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940725.549582:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.549591:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940725.549647:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738314112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.549683:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940725.549722:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940725.549968:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738314112 00000100:00100000:0.0:1788940725.549974:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738314112 00000100:00100000:0.0:1788940725.550011:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940725.550019:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738314112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788940725.550035:0:18991:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940725.550053:0:18991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940725.550057:0:18991:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788940725.550151:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738314112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940725.550158:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940725.550348:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738314112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940725.550402:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940725.550409:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940725.550418:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.805786:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940726.125419:0:19030:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788940726.125429:0:19030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940726.126228:0:19030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788940726.127850:0:19030:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940726.128067:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788940726.841917:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940727.854512:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940728.876657:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940729.328589:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940729.328596:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940729.328598:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940729.328601:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940729.328603:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788940729.328606:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788940729.328610:0:36:0:(import.c:65:import_set_state_nolock()) ffff89f1baa2b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940729.328639:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89f1baa2b000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940729.328822:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7833fd5-ba21-4794-9436-ab89d07c3023:3306:1875839738314240:0@lo:400:kworker.0 00000100:00100000:3.0:1788940729.328892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940729.328968:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ae852680 x1875839738314368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940729.329012:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738314240 00000100:00100000:0.0:1788940729.329019:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738314240 00000100:00100000:0.0:1788940729.329065:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940729.329074:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3306:x1875839738314240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940729.329127:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3306:x1875839738314240:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940729.329134:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940729.329181:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7833fd5-ba21-4794-9436-ab89d07c3023:3306:1875839738314240:0@lo:400:kworker.0 00000100:00100000:3.0:1788940729.329254:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738314368:0@lo:38:kworker.0 00000100:00100000:3.0:1788940729.329284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940729.331313:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738314368 00000100:00100000:0.0:1788940729.331326:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738314368 00000100:00100000:0.0:1788940729.331362:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940729.331369:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875839738314368:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788940729.331397:0:18998:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:0.0:1788940729.331436:0:18998:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27a633fcdd4c32f 00000004:00100000:0.0:1788940729.331452:0:18998:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940729.331746:0:18998:0:(import.c:65:import_set_state_nolock()) ffff89f18df7c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940729.331825:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875839738314368:12345-0@lo:38:kworker.0 Request processed in 455us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940729.331834:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940729.331934:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1ae852680 x1875839738314368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940729.331951:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788940729.331968:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940729.331973:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940729.331977:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1baa2b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940729.331984:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875839738314368:0@lo:38:kworker.0 00000001:02000400:1.0:1788940729.512387:0:19279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940729.910794:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940730.925395:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940731.949262:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940732.976397:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940733.314117:0:19431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2c4ef760 20000000:00000080:1.0:1788940733.314135:0:19431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f1844c0c00 uarg=0000000000000000 20000000:01000000:1.0:1788940733.314171:0:19431:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788940733.314210:0:19431:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788940733.314216:0:19431:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788940733.321823:0:19432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788940733.321994:0:19431:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788940733.333739:0:19431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940733.340799:0:19431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.340825:0:19431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.340835:0:19431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.340896:0:19431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.340913:0:19431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940733.340927:0:19431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19431:1875839738314496:0@lo:104: 00000100:00100000:2.0:1788940733.340992:0:19431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940733.341146:0:19431:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a9664b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940733.344843:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738314496 00000100:00100000:0.0:1788940733.345073:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738314496 00000100:00100000:0.0:1788940733.345200:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940733.345212:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19431:x1875839738314496:12345-0@lo:104: 00010000:00010000:0.0:1788940733.345297:0:18980:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.345498:0:18980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940733.345506:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19431:x1875839738314496:12345-0@lo:104: Request processed in 296us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940733.345514:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788940733.345602:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940733.345610:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940733.345618:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940733.345623:0:18985:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940733.345642:0:18985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940733.345650:0:18985:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940733.345656:0:18985:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940733.345698:0:18985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940733.345721:0:18985:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940733.345754:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940733.345762:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812eb000/0x27a633fcdd4c2f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c2f7 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940733.345778:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940733.345780:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940733.345782:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940733.345802:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940733.345814:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738314624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940733.346335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940733.348579:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738314624 00000100:00100000:0.0:1788940733.348595:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738314624 00010000:00010000:0.0:1788940733.348653:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 12 pid: 18989 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940733.348700:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940733.348709:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3308:x1875839738314624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940733.348721:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940733.348726:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 12 pid: 18989 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348755:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 12 pid: 18989 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348776:0:18981:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348784:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348802:0:18981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348809:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348816:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348824:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348830:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940733.348834:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348842:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348850:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940733.348885:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940733.348962:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3308:x1875839738314624:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940733.348970:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940733.350689:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738314624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940733.354069:0:19431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ea400/0x27a633fcdd4c2f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c2f0 expref: 11 pid: 18989 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940733.354091:0:19431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19431:1875839738314496:0@lo:104: 00010000:00010000:1.0:1788940733.354132:0:19431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.354445:0:19431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.354454:0:19431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.354461:0:19431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c336 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940733.439811:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940723/real 1788940723] req@ffff89f1ae851f80 x1875839738311680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940733.439846:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1ae851f80 x1875839738311680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940733.439870:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940723/real 1788940723] req@ffff89f1b5c6ea00 x1875839738311552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940733.439883:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f1b5c6ea00 x1875839738311552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940733.439901:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940733.439922:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788940733.439926:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738311680:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788940733.439940:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b897f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940733.439946:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788940733.439949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738311552:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788940733.439970:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940733.439976:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788940733.439979:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f1b897f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940733.439983:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1788940733.439988:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940733.439994:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f1b897f000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940733.440027:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f0821c1c00 x1875839738314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940733.440051:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940733.440054:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940733.440055:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940733.440071:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1788940733.440074:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940733.440078:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940733.440092:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f0821c2d80 x1875839738314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940733.440783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940733.440802:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738315008:0@lo:400:kworker.0 00000100:00100000:2.0:1788940733.440886:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940733.441096:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315008 00000100:00100000:3.0:1788940733.441115:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315008 00000100:00100000:3.0:1788940733.441166:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940733.441187:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738315008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940733.441245:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738315008:12345-0@lo:400:kworker.0 Request processed in 70us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940733.441251:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788940733.441623:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f0821c2a00 x1875839738315008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940733.441646:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738315008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940733.457436:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738314752:0@lo:8:kworker.0 00000400:00000100:1.0:1788940733.457514:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738314752 offset 0 length 520: 4 00000100:00100000:1.0:1788940733.457723:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738314880:0@lo:8:kworker.0 00000400:00000100:1.0:1788940733.457748:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839738314880 offset 0 length 520: 4 00010000:00010000:2.0:1788940733.996798:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940735.025127:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940735.088799:0:18993:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940735.088806:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bee49000 from 10 10000000:01000000:2.0:1788940735.088812:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940735.088858:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.088870:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.088881:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940735.088907:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940735.088970:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940735.089014:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a96640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940735.089035:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315136 00000100:00100000:2.0:1788940735.089041:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315136 00000100:00100000:2.0:1788940735.089087:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940735.089095:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+11:18993:x1875839738315136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940735.089108:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940735.089121:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c33d expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.089142:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 12 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.089182:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 12 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.089192:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521e00, rc 0) 00000100:00100000:2.0:1788940735.089226:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738315136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940735.089233:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940735.089279:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940735.089293:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940735.089301:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940735.089347:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940735.089367:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940735.089380:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1a96640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940735.089390:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315264 00000100:00100000:2.0:1788940735.089393:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315264 00000100:00100000:2.0:1788940735.089411:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940735.089417:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738315264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940735.091986:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738315264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2561us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940735.091998:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940735.092134:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940735.092194:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940735.092238:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940735.092263:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b0c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940735.092311:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315392 00000100:00100000:2.0:1788940735.092317:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315392 00000100:00100000:2.0:1788940735.092390:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940735.092398:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738315392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940735.092591:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:18993:x1875839738315392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940735.092597:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940735.105563:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738315392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940735.109895:0:19493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788940735.110152:0:18993:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788940735.110181:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940735.110192:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940735.110204:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940736.047706:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940736.365693:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788940737.069711:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940738.093025:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940738.541864:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940738.541871:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940738.541874:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940738.541877:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940738.542005:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738315520:0@lo:400:kworker.0 00000100:00100000:3.0:1788940738.542072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940738.542140:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940738.542146:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738315648:0@lo:400:kworker.0 00000100:00100000:3.0:1788940738.542172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940738.542203:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315648 00000100:00100000:3.0:1788940738.542210:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315648 00000100:00100000:3.0:1788940738.542264:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940738.542272:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940738.542320:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738315648:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940738.542327:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940738.542364:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b4cd2300 x1875839738315648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940738.542378:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738315648:0@lo:400:kworker.0 00000100:00100000:2.0:1788940738.544032:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315520 00000100:00100000:2.0:1788940738.544045:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315520 00000100:00100000:2.0:1788940738.544094:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940738.544103:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3305:x1875839738315520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940738.544186:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:3305:x1875839738315520:12345-0@lo:400:kworker.0 Request processed in 84us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940738.544193:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940738.544346:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738315520:0@lo:400:kworker.0 00010000:00010000:3.0:1788940739.116754:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940739.292822:0:19681:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940739.292826:0:19681:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788940739.292927:0:19681:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f190704000 00000020:01000004:2.0:1788940739.292943:0:19681:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788940739.292955:0:19681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940739.292982:0:19681:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89f1846c8000) 00000020:00000080:2.0:1788940739.292998:0:19681:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940739.313617:0:19681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788940739.313894:0:19681:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940739.314690:0:19681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940739.314901:0:19681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788940739.315179:0:19681:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788940739.315560:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788940739.315658:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788940739.315752:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788940739.316256:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1788940739.316488:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1788940739.316943:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788940739.317201:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1788940739.317438:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788940739.317712:0:19681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00000020:00000080:2.0:1788940739.318293:0:19681:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788940739.318304:0:19681:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940739.318315:0:19681:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4c352 00000020:01000004:2.0:1788940739.318324:0:19681:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788940739.318345:0:19681:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940739.318348:0:19681:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940739.318354:0:19681:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788940739.318358:0:19681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788940739.318369:0:19681:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff89f1846cb3b0) 00000020:00000080:2.0:1788940739.318379:0:19681:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788940739.319625:0:19681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940739.319797:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940739.319803:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788940739.320345:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940739.320352:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788940739.320718:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940739.320730:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788940739.321972:0:19681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940739.322160:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940739.322166:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788940739.326474:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788940739.326491:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788940739.347954:0:19681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940739.348177:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788940739.348184:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788940739.349646:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788940739.349658:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788940739.350364:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788940739.350372:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788940739.352330:0:19681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940739.352555:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940739.352561:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788940739.353104:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788940739.353111:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788940739.379716:0:19681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940739.379948:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788940739.379956:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788940739.381435:0:19681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788940739.381444:0:19681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788940739.381819:0:19681:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788940739.381839:0:19681:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788940739.381844:0:19681:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788940739.389395:0:19681:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788940739.389448:0:19681:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788940739.389453:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788940739.389455:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940739.389456:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940739.389462:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940739.389463:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940739.389465:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940739.389466:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940739.389468:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940739.389469:0:19681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940739.389473:0:19681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788940739.389474:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940739.389476:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940739.389477:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940739.389478:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940739.389478:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940739.389479:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940739.389480:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940739.389481:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940739.389482:0:19681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940739.389507:0:19681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788940739.389654:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738315776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788940739.389722:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.389832:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.389874:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315776 00000100:00100000:2.0:1788940739.389882:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315776 00000100:00100000:2.0:1788940739.389973:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940739.389984:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19681:x1875839738315776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940739.390012:0:18991:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788940739.390016:0:18991:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788940739.390019:0:18991:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788940739.395416:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19681:x1875839738315776:12345-0@lo:253:mount.lustre.0 Request processed in 5425us (5685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.395430:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940739.395506:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738315776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788940739.395645:0:19681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788940739.395649:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940739.395651:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940739.395652:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940739.395653:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940739.395654:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940739.395655:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940739.395657:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940739.395658:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940739.395660:0:19681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788940739.395680:0:19681:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f190704000 from lustre-OST0000 10000000:01000000:1.0:1788940739.395703:0:19681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788940739.395706:0:19681:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940739.395712:0:19681:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1b5184d88 local copy 00010000:00010000:1.0:1788940739.395722:0:19681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940739.395940:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738315904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940739.395978:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.396054:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.396090:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738315904 00000100:00100000:3.0:1788940739.396097:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738315904 00000100:00100000:3.0:1788940739.396196:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940739.396205:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19681:x1875839738315904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940739.396355:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19681:x1875839738315904:12345-0@lo:501:mount.lustre.0 Request processed in 150us (376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940739.396362:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940739.396418:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738315904:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788940739.396430:0:19681:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788940739.396613:0:19681:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788940739.396619:0:19681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.396628:0:19681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940739.396649:0:19681:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f190704000 10000000:01000000:1.0:1788940739.396654:0:19681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940739.396659:0:19681:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89f1b5184d88 10000000:01000000:1.0:1788940739.396661:0:19681:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788940739.396664:0:19681:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89f1b5184d88 from 1 10000000:01000000:1.0:1788940739.396667:0:19681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788940739.396689:0:19681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.396697:0:19681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.396705:0:19681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940739.396717:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940739.396750:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.396973:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.397038:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316032 00000100:00100000:0.0:1788940739.397044:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316032 00000100:00100000:0.0:1788940739.397071:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940739.397078:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+12:19681:x1875839738316032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940739.397087:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940739.397100:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eba00/0x27a633fcdd4c367 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c360 expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.397130:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eba00/0x27a633fcdd4c367 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c360 expref: 13 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.397141:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eba00/0x27a633fcdd4c367 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c360 expref: 13 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.397149:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eba00, rc 0) 00000100:00100000:0.0:1788940739.397261:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+13:19681:x1875839738316032:12345-0@lo:101:mount.lustre.0 Request processed in 182us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.397267:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940739.397355:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940739.397368:0:19681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c367 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.397377:0:19681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c367 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940739.397394:0:19681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788940739.397447:0:19681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c367 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.397454:0:19681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258c600/0x27a633fcdd4c360 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c367 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940739.397461:0:19681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940739.397465:0:19681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940739.397469:0:19681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788940739.397471:0:19681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940739.397486:0:19681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.397494:0:19681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.397501:0:19681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940739.397514:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940739.397592:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.397619:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.397728:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316160 00000100:00100000:2.0:1788940739.397734:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316160 00000100:00100000:2.0:1788940739.397759:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788940739.397766:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+13:19681:x1875839738316160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940739.397774:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940739.397784:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c36e expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.397798:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c36e expref: 14 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.397806:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521c00/0x27a633fcdd4c375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c36e expref: 14 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.397812:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521c00, rc 0) 00000100:00100000:2.0:1788940739.397853:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316160:12345-0@lo:101:mount.lustre.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.397859:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940739.397964:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940739.397975:0:19681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c375 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.397982:0:19681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c375 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940739.398766:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788940739.399826:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940739.400081:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788940739.400144:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788940739.400183:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788940739.400230:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788940739.400266:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788940739.400301:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788940739.400351:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788940739.400390:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788940739.400425:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788940739.400472:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788940739.400507:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788940739.400799:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788940739.400867:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788940739.400875:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788940739.400961:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940739.401024:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.401070:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.401155:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316288 00000100:00100000:2.0:1788940739.401162:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316288 00000100:00100000:2.0:1788940739.401226:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940739.401236:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940739.401609:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316288:12345-0@lo:501:mount.lustre.0 Request processed in 374us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.401617:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940739.401800:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940739.401847:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940739.401888:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.401909:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.401965:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316416 00000100:00100000:2.0:1788940739.401971:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316416 00000100:00100000:2.0:1788940739.402008:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940739.402015:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940739.403171:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316416:12345-0@lo:503:mount.lustre.0 Request processed in 1153us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.403181:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940739.403318:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940739.404280:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940739.404371:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940739.404426:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.404562:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834f56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.404721:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316544 00000100:00100000:2.0:1788940739.404728:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316544 00000100:00100000:2.0:1788940739.404820:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940739.404830:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940739.405033:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316544:12345-0@lo:502:mount.lustre.0 Request processed in 204us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.405041:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940739.405129:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940739.405343:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788940739.405390:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788940739.405427:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788940739.405473:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788940739.405510:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788940739.405630:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788940739.405681:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788940739.405719:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788940739.405751:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788940739.405800:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788940739.405838:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788940739.405888:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788940739.405920:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940739.405976:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.406264:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f195f93240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.406337:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316672 00000100:00100000:3.0:1788940739.406344:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316672 00000100:00100000:3.0:1788940739.406378:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940739.406386:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940739.406601:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316672:12345-0@lo:502:mount.lustre.0 Request processed in 215us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.406609:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940739.406788:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940739.406869:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788940739.406886:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788940739.407779:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940739.407788:0:19695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788940739.407795:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.407796:0:19695:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788940739.407801:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940739.407817:0:19695:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff89f1b51819d8) 00000020:00000080:1.0:1788940739.407839:0:19695:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940739.407844:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940739.407917:0:19695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f190704000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788940739.407926:0:19695:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940739.407933:0:19695:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27a633fcdd4c383 00010000:00010000:1.0:1788940739.411857:0:19695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788940739.412299:0:19695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788940739.415148:0:19695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788940739.416497:0:19695:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788940739.416509:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940739.416514:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416548:0:19695:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788940739.416553:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940739.416555:0:19695:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788940739.416556:0:19695:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940739.416558:0:19695:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940739.416560:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940739.416564:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416565:0:19695:0:(obd_config.c:1662:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940739.416567:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940739.416580:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416581:0:19695:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940739.416584:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940739.416586:0:19695:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940739.416588:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940739.416590:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416591:0:19695:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940739.416601:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940739.416604:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416606:0:19695:0:(obd_config.c:1662:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940739.416609:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788940739.416661:0:19695:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940739.416664:0:19695:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940739.416665:0:19695:0:(obd_config.c:1662:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940739.416669:0:19695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788940739.416884:0:19681:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788940739.416906:0:19681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788940739.416921:0:19681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c375 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.416933:0:19681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f19258d600/0x27a633fcdd4c36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c375 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940739.416941:0:19681:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f190704000 from 1 10000000:01000000:3.0:1788940739.416944:0:19681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940739.416981:0:19681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.416989:0:19681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.417001:0:19681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940739.417033:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940739.417098:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.417156:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.417259:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316800 00000100:00100000:1.0:1788940739.417267:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316800 00000100:00100000:1.0:1788940739.417311:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940739.417321:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+14:19681:x1875839738316800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940739.417333:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940739.417345:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c38a expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.417368:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 15 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.417378:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 15 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.417386:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f19258de00, rc 0) 00000100:00100000:1.0:1788940739.417435:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738316800:12345-0@lo:101:mount.lustre.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.417442:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940739.417567:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940739.417594:0:19681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.417603:0:19681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940739.418074:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788940739.418814:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940739.419035:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788940739.419080:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788940739.419146:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788940739.419187:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788940739.419223:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788940739.419268:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788940739.419305:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788940739.419340:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788940739.419406:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788940739.419413:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788940739.419489:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940739.419564:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.419595:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.419815:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738316928 00000100:00100000:2.0:1788940739.419821:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738316928 00000100:00100000:2.0:1788940739.419858:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940739.419867:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738316928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940739.420051:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738316928:12345-0@lo:501:mount.lustre.0 Request processed in 185us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.420058:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940739.420814:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738316928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940739.420854:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940739.420906:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.420938:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.421019:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317056 00000100:00100000:2.0:1788940739.421026:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317056 00000100:00100000:2.0:1788940739.421063:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940739.421071:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940739.421240:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317056:12345-0@lo:503:mount.lustre.0 Request processed in 168us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.421247:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940739.421348:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788940739.421951:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940739.422013:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940739.422056:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.422085:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.422147:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317184 00000100:00100000:0.0:1788940739.422153:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317184 00000100:00100000:0.0:1788940739.422188:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940739.422196:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940739.422368:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317184:12345-0@lo:502:mount.lustre.0 Request processed in 172us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.422375:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940739.422506:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940739.422873:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788940739.422922:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788940739.422973:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788940739.423009:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788940739.423043:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788940739.423084:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788940739.423127:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788940739.423160:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788940739.423185:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940739.423226:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.423299:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.428302:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317312 00000100:00100000:0.0:1788940739.428318:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317312 00000100:00100000:0.0:1788940739.428831:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940739.428858:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940739.429147:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317312:12345-0@lo:502:mount.lustre.0 Request processed in 291us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.429155:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788940739.429259:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940739.429411:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788940739.429426:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788940739.433915:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940739.433932:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.433934:0:19699:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788940739.433940:0:19699:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f190704000 00000020:00000080:3.0:1788940739.433943:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940739.433958:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940739.433960:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.433962:0:19699:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788940739.433964:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940739.433967:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.433968:0:19699:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788940739.433971:0:19699:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f190704000 00000020:00000080:3.0:1788940739.433973:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940739.434031:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940739.434034:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.434036:0:19699:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788940739.434038:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940739.434041:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.434042:0:19699:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940739.434045:0:19699:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f190704000 00000020:00000080:3.0:1788940739.434048:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940739.434085:0:19699:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940739.434088:0:19699:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.434090:0:19699:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788940739.434093:0:19699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788940739.435696:0:19681:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788940739.435728:0:19681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940739.435745:0:19681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.435759:0:19681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940739.435804:0:19681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940739.435807:0:19681:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f190704000 10000000:01000000:0.0:1788940739.435810:0:19681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f190704000 10000000:01000000:0.0:1788940739.435813:0:19681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940739.435818:0:19681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f190704000 from 1 10000000:01000000:0.0:1788940739.435821:0:19681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940739.435854:0:19681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.435862:0:19681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.435881:0:19681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940739.435905:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940739.435971:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.436018:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.436396:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317440 00000100:00100000:2.0:1788940739.436403:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317440 00000100:00100000:2.0:1788940739.439298:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940739.439316:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738317440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940739.439334:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940739.439351:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181521000/0x27a633fcdd4c39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c398 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.439376:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181521000/0x27a633fcdd4c39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c398 expref: 16 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.439387:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181521000/0x27a633fcdd4c39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c398 expref: 16 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.439394:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181521000, rc 0) 00000100:00100000:2.0:1788940739.439460:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317440:12345-0@lo:101:mount.lustre.0 Request processed in 151us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.439466:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940739.443901:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940739.443929:0:19681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c39f expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.443943:0:19681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c39f expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940739.445250:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788940739.446776:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940739.447080:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788940739.447142:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788940739.447177:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788940739.447217:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788940739.447253:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788940739.447302:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788940739.447339:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788940739.447371:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788940739.447427:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788940739.447467:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788940739.447503:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788940739.450737:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788940739.450868:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788940739.450906:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788940739.450996:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788940739.451039:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788940739.451075:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788940739.451139:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788940739.451179:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788940739.451217:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788940739.451269:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788940739.451308:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788940739.451343:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788940739.451393:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788940739.451432:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788940739.451467:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788940739.453739:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788940739.453870:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788940739.453906:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788940739.453999:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788940739.454039:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788940739.454074:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788940739.454103:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788940739.454164:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788940739.454200:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788940739.454246:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788940739.454298:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788940739.454334:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788940739.454380:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788940739.454419:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788940739.454554:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788940739.454562:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788940739.456323:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940739.456387:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.456684:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.461769:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317568 00000100:00100000:1.0:1788940739.461785:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317568 00000100:00100000:1.0:1788940739.461831:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940739.461840:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940739.462144:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317568:12345-0@lo:501:mount.lustre.0 Request processed in 305us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.462153:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940739.462267:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940739.462333:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940739.462379:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.462417:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.462433:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317696 00000100:00100000:0.0:1788940739.462436:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317696 00000100:00100000:0.0:1788940739.462467:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940739.462474:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940739.462640:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317696:12345-0@lo:503:mount.lustre.0 Request processed in 166us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.462647:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940739.462680:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317696:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940739.463154:0:19681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940739.463219:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940739.463258:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.463275:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.463292:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317824 00000100:00100000:0.0:1788940739.463297:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317824 00000100:00100000:0.0:1788940739.463318:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940739.463325:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940739.463480:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317824:12345-0@lo:502:mount.lustre.0 Request processed in 154us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.463487:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940739.463553:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940739.463789:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788940739.463837:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788940739.463886:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788940739.463939:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788940739.463979:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788940739.464030:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788940739.464069:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788940739.464101:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788940739.464214:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788940739.464256:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788940739.464292:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788940739.464347:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788940739.464380:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788940739.464409:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788940739.464449:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788940739.464481:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788940739.464512:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788940739.464578:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788940739.464607:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788940739.464634:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788940739.464669:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788940739.464699:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788940739.464732:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788940739.464781:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788940739.464832:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788940739.464864:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788940739.464914:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788940739.464951:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788940739.464983:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788940739.465034:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788940739.465072:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788940739.465109:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788940739.476049:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788940739.476150:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788940739.476190:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788940739.476272:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788940739.476312:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788940739.476347:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788940739.476410:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788940739.476468:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788940739.476567:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940739.477745:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.477788:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940739.477858:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738317952 00000100:00100000:2.0:1788940739.477867:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738317952 00000100:00100000:2.0:1788940739.477918:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940739.477928:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940739.478181:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738317952:12345-0@lo:502:mount.lustre.0 Request processed in 255us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.478189:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940739.478281:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738317952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940739.478384:0:19681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788940739.478396:0:19681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788940739.483941:0:19704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788940739.483958:0:19704:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89f1982e19d8) 00000020:00000080:0.0:1788940739.483978:0:19704:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788940739.484045:0:19704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f190704000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940739.484049:0:19704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f190704000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940739.484051:0:19704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f190704000 3 00010000:00080000:0.0:1788940739.484081:0:19704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b50a0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940739.486952:0:19704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788940739.487213:0:19704:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788940739.487255:0:19704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940739.487267:0:19704:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27a633fcdd4c3ad 00000100:00080000:1.0:1788940739.487278:0:19704:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940739.487284:0:19704:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89f1b50a0000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940739.487322:0:19704:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6d180 x1875839738318080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940739.487356:0:19704:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940739.487442:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940739.487448:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940739.487450:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940739.487453:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940739.487512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940739.487549:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738318208:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.487624:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.487665:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318208 00000100:00100000:0.0:1788940739.487671:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318208 00000100:00100000:0.0:1788940739.487719:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940739.487726:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738318208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.487772:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738318208:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.487779:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940739.487812:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1ae852680 x1875839738318208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940739.487825:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738318208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.488334:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738318080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940739.488372:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.489047:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318080 00000100:00100000:0.0:1788940739.489054:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318080 00000100:00100000:0.0:1788940739.489087:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940739.489093:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875839738318080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788940739.489129:0:18997:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:0.0:1788940739.489163:0:18997:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27a633fcdd4c3b4 00000004:00100000:0.0:1788940739.489179:0:18997:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940739.489210:0:18997:0:(import.c:65:import_set_state_nolock()) ffff89f1b50a4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940739.489264:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875839738318080:12345-0@lo:38:llog_process_th.0 Request processed in 169us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.489272:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940739.489312:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89f1b5c6d180 x1875839738318080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940739.489321:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940739.489328:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788940739.489334:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940739.489338:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940739.489352:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b50a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940739.489358:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875839738318080:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788940739.489788:0:19704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788940739.490226:0:19681:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788940739.490252:0:19681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940739.490271:0:19681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c39f expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.490282:0:19681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812ea600/0x27a633fcdd4c398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c39f expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940739.490324:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940739.490326:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940739.490327:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940739.490328:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940739.490330:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940739.490331:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940739.490332:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940739.490334:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940739.490335:0:19681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940739.490339:0:19681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788940739.490341:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940739.490343:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940739.490344:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940739.490344:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940739.490345:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940739.490346:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940739.490347:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940739.490348:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940739.490349:0:19681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940739.490370:0:19681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788940739.490385:0:19681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738318336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788940739.490433:0:19681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.490504:0:19681:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f0829006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.490736:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318336 00000100:00100000:1.0:1788940739.490743:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318336 00000100:00100000:1.0:1788940739.490786:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940739.490795:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:19681:x1875839738318336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788940739.490817:0:18989:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788940739.490831:0:18989:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788940739.538623:0:18989:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940739.538638:0:18989:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788940739.538705:0:19012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940739.538711:0:19012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940739.538734:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.538753:0:19012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 16 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.538762:0:19012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.538799:0:19012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 16 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.538813:0:19012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 16 pid: 18990 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940739.538827:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738318464:0@lo:104: 00000100:00100000:2.0:1788940739.538893:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.538939:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c12c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.539067:0:18979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318464 00000100:00100000:1.0:1788940739.539075:0:18979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318464 00000100:00100000:1.0:1788940739.539136:0:18979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940739.539145:0:18979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738318464:12345-0@lo:104: 00010000:00010000:1.0:1788940739.539162:0:18979:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.539225:0:18979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940739.539242:0:18979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738318464:12345-0@lo:104: Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.539250:0:18979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940739.539269:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738318464:0@lo:104: 00010000:00010000:3.0:1788940739.539288:0:19012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.540630:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940739.540639:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.540649:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eaa00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:1.0:1788940739.540653:0:18984:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.540662:0:18984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940739.540668:0:18984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940739.540674:0:18984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940739.540717:0:18984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.540724:0:18984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940739.540745:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.540753:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f0812eaa00/0x27a633fcdd4c321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c328 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940739.540755:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788940739.540771:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940739.540773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738318592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940739.540773:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940739.540775:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940739.540822:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.540865:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318592 00000100:00100000:2.0:1788940739.540871:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318592 00010000:00010000:2.0:1788940739.540894:0:18983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 17 pid: 18990 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940739.541069:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940739.541078:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:3307:x1875839738318592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940739.541091:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940739.541096:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 17 pid: 18990 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541108:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 17 pid: 18990 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541132:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c321 expref: 17 pid: 18990 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541145:0:18983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541153:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940739.541167:0:18983:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002457654s 00010000:00010000:2.0:1788940739.541171:0:18983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541177:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541184:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541190:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541202:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940739.541206:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541214:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541226:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.541236:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940739.541268:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3307:x1875839738318592:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.541275:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940739.542177:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738318592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940739.542677:0:19012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.542688:0:19012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940739.542694:0:19012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181520200/0x27a633fcdd4c3bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940739.557782:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+15:19681:x1875839738318336:12345-0@lo:253:mount.lustre.0 Request processed in 66979us (67340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.557809:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940739.558090:0:19681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:19681:1875839738318336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940739.558105:0:19681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788940739.558108:0:19681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940739.558110:0:19681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940739.558126:0:19681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940739.558127:0:19681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940739.558129:0:19681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940739.558130:0:19681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940739.558131:0:19681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940739.558133:0:19681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940739.558134:0:19681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940739.558150:0:19681:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788940739.558867:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940739.559209:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940739.559372:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940739.564823:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940739.565008:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940739.565194:0:19681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788940739.565957:0:19681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788940739.662907:0:19681:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788940739.662917:0:19681:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788940739.662951:0:19681:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940739.663007:0:19681:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940739.663020:0:19681:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788940739.663062:0:19681:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788940740.140917:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940741.173745:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940741.356640:0:18993:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940741.356649:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1bee49000 from 10 10000000:01000000:2.0:1788940741.356654:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940741.356707:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.356720:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.356731:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940741.356758:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738318720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940741.356832:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940741.356967:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b89a3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940741.357657:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318720 00000100:00100000:0.0:1788940741.357668:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318720 00000100:00100000:0.0:1788940741.357733:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940741.357743:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+15:18993:x1875839738318720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940741.357758:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940741.357775:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c3c2 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357800:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 16 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357811:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 16 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357821:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ebe00, rc 0) 00000100:00100000:0.0:1788940741.357873:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:18993:x1875839738318720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.357879:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940741.367047:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738318720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940741.367079:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.367093:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940741.367185:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738318848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940741.367252:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940741.375319:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940741.393377:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318848 00000100:00100000:0.0:1788940741.393392:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318848 00000100:00100000:0.0:1788940741.393460:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940741.393473:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:18993:x1875839738318848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788940741.393500:0:18989:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940741.393542:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940741.393546:0:18989:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788940741.393694:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:18993:x1875839738318848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 217us (26433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.393707:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940741.393754:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738318848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940741.393832:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940741.393842:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.393853:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.188738:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940743.212722:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940744.237015:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940744.688144:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940744.688150:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940744.688152:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940744.688155:0:38:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788940744.688204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738319232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.688320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940744.688458:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738318976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.688492:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940744.688548:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940744.688555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738319104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.688595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940744.688642:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319232 00000100:00100000:1.0:1788940744.688650:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319232 00000100:00100000:1.0:1788940744.688692:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319104 00000100:00100000:1.0:1788940744.688695:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319104 00000100:00100000:1.0:1788940744.688712:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940744.688719:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738319232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.688787:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738319232:12345-0@lo:400:kworker.0 Request processed in 68us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.688795:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940744.688813:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940744.688841:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738319104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.688878:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738319104:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.688884:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788940744.688919:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd1f80 x1875839738319104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940744.688932:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738319104:0@lo:400:kworker.0 00010000:00080000:1.0:1788940744.688975:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd0380 x1875839738319232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940744.688984:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738319232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.689552:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738318976 00000100:00100000:2.0:1788940744.689558:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738318976 00000100:00100000:2.0:1788940744.689626:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940744.689636:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3305:x1875839738318976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.689679:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3305:x1875839738318976:12345-0@lo:400:kworker.0 Request processed in 45us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.689685:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788940744.689736:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940744.689944:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738318976:0@lo:400:kworker.0 00010000:00010000:3.0:1788940745.263377:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940746.286891:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940746.610550:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788940747.173967:0:20050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940747.309140:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940748.332689:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940748.721454:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940733/real 1788940733] req@ffff89f0821c1c00 x1875839738314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940748.721489:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f0821c1c00 x1875839738314752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940748.721500:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940733/real 1788940733] req@ffff89f0821c2d80 x1875839738314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940748.721512:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89f0821c2d80 x1875839738314880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940748.721558:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b897f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940748.721604:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940748.721608:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738314752:0@lo:8:kworker.0 00000100:00080000:1.0:1788940748.721615:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940748.721620:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940748.721623:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738314880:0@lo:8:kworker.0 00000100:00080000:2.0:1788940748.721747:0:20067:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940748.721753:0:20067:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788940748.721756:0:20067:0:(import.c:65:import_set_state_nolock()) ffff89f1b897f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940748.721761:0:20067:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788940748.721783:0:20067:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788940748.721790:0:20067:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89f1b897f000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940748.721810:0:20067:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd0000 x1875839738319488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940748.721823:0:20067:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940748.721826:0:20067:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940748.721828:0:20067:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940748.721831:0:20067:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788940748.721834:0:20067:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788940748.721837:0:20067:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940748.721849:0:20067:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd0a80 x1875839738319616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940748.722104:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940748.722116:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738319360:0@lo:400:kworker.0 00000100:00100000:1.0:1788940748.722174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940748.722234:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738319744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940748.722318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940748.722348:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940748.722354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738319872:0@lo:400:kworker.0 00000100:00100000:1.0:1788940748.722375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940748.722404:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319744 00000100:00100000:1.0:1788940748.722411:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319744 00000100:00100000:1.0:1788940748.722449:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319872 00000100:00100000:1.0:1788940748.722452:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319872 00000100:00100000:1.0:1788940748.722478:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940748.722486:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738319744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940748.722560:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738319744:12345-0@lo:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.722567:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940748.722583:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940748.723010:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319360 00000100:00100000:2.0:1788940748.723015:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319360 00000100:00100000:2.0:1788940748.723057:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940748.723065:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3307:x1875839738319360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940748.723118:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3307:x1875839738319360:12345-0@lo:400:kworker.0 Request processed in 54us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940748.723124:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940748.723182:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738319488:0@lo:8:kworker.0 00000100:00100000:2.0:1788940748.723213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940748.723238:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738319616:0@lo:8:kworker.0 00000100:00100000:2.0:1788940748.723261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940748.723309:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940748.723347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd0e00 x1875839738319744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940748.723370:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738319744:0@lo:400:kworker.0 00000100:00100000:2.0:1788940748.723406:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738319360:0@lo:400:kworker.0 00000100:00100000:2.0:1788940748.723448:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319488 00000100:00100000:2.0:1788940748.723452:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319488 00000100:00100000:2.0:1788940748.723468:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738319616 00000100:00100000:2.0:1788940748.723471:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738319616 00000100:00100000:2.0:1788940748.723481:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940748.723485:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738319488:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788940748.723508:0:19682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1788940748.723568:0:19682:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4c3d0 00002000:00100000:2.0:1788940748.723582:0:19682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89f1b5c5f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788940748.723586:0:19682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788940748.723588:0:19682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788940748.724205:0:19682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940748.724229:0:19682:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940748.724474:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940748.724539:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738319872:12345-0@lo:400:kworker.0 Request processed in 1950us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.724558:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788940748.724675:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd0380 x1875839738319872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940748.724687:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738319872:0@lo:400:kworker.0 00000100:00100000:2.0:1788940748.726576:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738319488:12345-0@lo:8:kworker.0 Request processed in 3081us (3354us total) trans 0 rc 0/0 00010000:00080000:0.0:1788940748.726955:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd0000 x1875839738319488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940748.726966:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940748.726975:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788940748.726983:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788940748.726989:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788940748.726992:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b897f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788940748.727007:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788940748.727012:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738319488:0@lo:8:kworker.0 00000100:00100000:2.0:1788940748.727315:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940748.728502:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940748.728511:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738319616:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788940748.728546:0:19682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000004:00080000:3.0:1788940748.731209:0:19019:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788940748.731238:0:19019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19019:1875839738320128:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788940748.731301:0:19019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940748.731348:0:19019:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1901206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940748.731374:0:19683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940748.731381:0:19683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1788940748.731405:0:19018:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788940748.734104:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940748.734129:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738320000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940748.734231:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788940748.736304:0:19018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691634783580ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788940748.737309:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320000 00000100:00100000:1.0:1788940748.737321:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320000 00000100:00100000:1.0:1788940748.743964:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940748.743989:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738320000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940748.744029:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940748.747123:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875839738320000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3138us (12883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.747137:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788940748.747187:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940748.747224:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320128 00000100:00100000:1.0:1788940748.747232:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320128 00000100:00100000:1.0:1788940748.747326:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940748.747335:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19019:x1875839738320128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788940748.757460:0:20097:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788940748.757471:0:20097:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788940748.757477:0:20097:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:65) 00010000:00080000:0.0:1788940748.758931:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f0821c3480 x1875839738320000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940748.758958:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738320000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940748.776897:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738319616:12345-0@lo:8:kworker.0 Request processed in 48379us (53628us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940748.776910:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788940748.776974:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940748.776980:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940748.776985:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738319616:0@lo:8:kworker.0 00002000:00010000:1.0:1788940748.822800:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.822812:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822830:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.822834:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.822848:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822865:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822875:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822883:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822902:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.822915:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.822921:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822929:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.822933:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822942:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822958:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822978:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf131944/0x27a633fcdd4c3d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.822994:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.822997:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.822998:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.828422:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.829420:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829445:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.829450:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.829456:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829470:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829704:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829715:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829735:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.829748:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.829761:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829832:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.829837:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829848:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829864:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829871:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9fdc77/0x27a633fcdd4c3de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.829889:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.829890:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.829892:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.831300:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.831310:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831324:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.831338:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.831344:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831368:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831377:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831383:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831404:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.831419:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.831434:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831442:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ce00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.831445:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831453:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831466:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831474:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002948a24c/0x27a633fcdd4c3e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.831739:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.831741:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.831743:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.832357:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.832364:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832375:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.832378:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.832383:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832393:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832402:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832408:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832425:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.832434:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.832438:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832456:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258ca00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.832460:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832468:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.832478:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.835843:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e75ffbd/0x27a633fcdd4c3ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.835876:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.835878:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.835881:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.842230:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.842245:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842262:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.842266:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.842273:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842287:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842305:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842313:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842346:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.842361:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.842366:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842373:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.842377:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842387:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842404:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842411:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075211af8/0x27a633fcdd4c3f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.842429:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.842436:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.842438:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.850155:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.850168:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850185:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.850190:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.850197:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850212:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850223:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850231:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850250:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.850263:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.850268:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850277:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258da00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.850282:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850302:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850319:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850342:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e111edd6/0x27a633fcdd4c3fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850361:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.850363:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.850365:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.850845:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.850851:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850861:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.850864:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.850869:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850878:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850886:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850898:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850913:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.850922:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.850926:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850933:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258dc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.850936:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850944:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850955:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850961:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b35c2fd/0x27a633fcdd4c401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.850973:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.850975:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.850976:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.860171:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.860194:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.860210:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.860215:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.860222:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.860236:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.860942:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.860955:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.860979:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940748.860996:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.861002:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.861009:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258cc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.861013:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.861022:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.861058:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.861065:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008923fba9/0x27a633fcdd4c408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.861086:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.861088:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.861090:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.865257:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.865272:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.865288:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.865293:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.865300:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.865312:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.865334:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.865343:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.865387:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940748.865927:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940748.865936:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.865945:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.865950:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.865960:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.865979:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.865988:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000967092a/0x27a633fcdd4c40f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.866009:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.866011:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.866013:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.867348:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.867357:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.867371:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.867376:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.867382:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.867393:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.867402:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.867410:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.867435:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940748.867546:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940748.867554:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.867584:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.867587:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.867596:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.867610:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.867617:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26e05c2/0x27a633fcdd4c416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.867635:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.867637:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.867639:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.869574:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.869583:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.870967:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.870980:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.870988:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871005:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871015:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871021:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871060:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940748.871902:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.871910:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871921:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.871924:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.871929:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871939:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871947:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871959:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.871974:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940748.873666:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940748.873677:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873689:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258c400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.873694:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873704:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873735:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873744:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a4632b4/0x27a633fcdd4c41d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873769:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940748.873773:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873779:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f19258d000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.873783:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873790:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873799:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873806:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d433f2c/0x27a633fcdd4c424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.873820:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.873822:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.873829:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.873836:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.876215:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.876229:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.876245:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.876250:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.876257:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.876271:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.876282:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.876290:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.877496:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940748.882160:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.882172:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.882196:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.882201:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.882208:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.882223:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.882233:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.882241:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940748.883088:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788940748.890021:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940748.890047:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.890061:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.890066:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.890091:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.890115:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.890145:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912f2fa4/0x27a633fcdd4c42b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.890261:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940748.890273:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.890280:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940748.890283:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.890290:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.890302:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.890310:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940748.890317:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940748.890319:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.894218:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.894259:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788940748.894270:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940748.895153:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.895162:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.895175:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.895179:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.895185:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.895209:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.895218:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.895226:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.897078:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940748.897648:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.897657:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.897672:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.897677:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.897683:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.897695:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.897704:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.897724:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.901665:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940748.901847:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940748.901856:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901870:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.901875:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901886:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901907:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901915:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901951:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940748.901954:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901961:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.901964:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901971:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901980:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901986:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000956009bf/0x27a633fcdd4c440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.901998:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.902000:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.902002:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.902439:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.903100:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.903109:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.903121:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.903125:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.903132:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.903144:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.903154:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.903162:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.903184:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940748.904887:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940748.904899:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.904912:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.904917:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.904927:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.904946:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.904953:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74d2b5e/0x27a633fcdd4c447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.904974:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.904976:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.904978:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.909441:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.909455:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.909477:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.912430:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.912445:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.912464:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.912475:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.912554:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.912578:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940748.913617:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940748.913626:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.913635:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.913647:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.913657:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.913674:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.913682:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133c7c80/0x27a633fcdd4c44e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.913704:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.913706:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.913708:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.914177:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.914184:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.914196:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.914200:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.914206:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.914216:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.914233:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.914241:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.914260:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940748.914433:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940748.914439:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.914457:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940748.914460:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.914468:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.914479:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.914499:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae7562e/0x27a633fcdd4c455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.914513:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.914515:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940748.914531:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940748.918306:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.918318:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.919607:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.919613:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.919620:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.919636:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.919647:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.919655:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.919691:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940748.919868:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940748.919875:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.919883:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.919888:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.919897:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.919914:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.919928:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d0aa6/0x27a633fcdd4c45c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.919952:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.919954:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.919956:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940748.935250:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.935264:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935281:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.935285:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.935292:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935305:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935315:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935333:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935361:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940748.935873:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.935886:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935894:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.935898:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.935901:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935910:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935917:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935924:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.935944:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788940748.936323:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.936329:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936337:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.936340:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.936343:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936351:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936364:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936371:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936378:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788940748.936776:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.936782:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936791:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.936794:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.936798:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936806:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936814:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936820:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.936856:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788940748.937226:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.937231:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937239:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.937242:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.937246:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937255:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937263:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937270:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937279:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788940748.937681:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.937687:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937695:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.937704:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.937708:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937718:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937726:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937733:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.937742:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788940748.938684:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788940748.938693:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938703:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938707:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938716:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938732:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938738:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a75094/0x27a633fcdd4c463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938758:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788940748.938773:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938779:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ebc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938782:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938803:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938813:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938820:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099639234/0x27a633fcdd4c46a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938832:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788940748.938835:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938841:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938843:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938850:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938859:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938865:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03bdf72/0x27a633fcdd4c471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938886:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940748.938889:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938895:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938898:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938904:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938913:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938920:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003091758f/0x27a633fcdd4c478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938930:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940748.938932:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938938:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938940:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938955:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938964:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938971:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee219f48/0x27a633fcdd4c47f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938982:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940748.938985:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.938991:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940748.938994:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.939000:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.939008:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.939015:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005215e8ae/0x27a633fcdd4c486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.939057:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.939058:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940748.939060:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940748.939750:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940748.939758:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.942932:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788940748.942937:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940748.942945:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.942963:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.942975:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.942999:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943088:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940748.943701:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.943709:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943720:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.943723:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.943728:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943737:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943745:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943751:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.943760:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788940748.944152:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.944158:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944177:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.944180:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.944189:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944199:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944206:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944212:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944220:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788940748.944587:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.944593:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944601:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.944604:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.944608:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944616:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944633:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944641:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944650:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788940748.944986:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.944991:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.944999:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.945002:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.945006:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945015:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945022:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945043:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945062:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788940748.945390:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940748.945395:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945404:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=691s v=(0 0) 00010000:00010000:1.0:1788940748.945407:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940748.945411:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945419:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945427:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945435:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940748.945442:0:20097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:1.0:1788940748.945971:0:20097:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1788940748.947300:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788940748.947312:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947335:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947340:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947350:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947369:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947377:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011e8ed91/0x27a633fcdd4c48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947404:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788940748.947409:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947415:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947441:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947449:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947459:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947465:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de6a393f/0x27a633fcdd4c494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947479:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940748.947664:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947671:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947674:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947680:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947690:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947696:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71178a2/0x27a633fcdd4c49b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947717:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940748.947721:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947727:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947730:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947738:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947748:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947754:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007659df10/0x27a633fcdd4c4a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947773:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940748.947777:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947783:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947786:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947805:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947815:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947822:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b243293f/0x27a633fcdd4c4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947836:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940748.947840:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947847:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940748.947849:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947856:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947865:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947872:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084c6126/0x27a633fcdd4c4b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.947895:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.947897:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.947899:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.948696:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940748.952016:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19019:x1875839738320128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 204672us (220704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.952039:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940748.952190:0:19019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19019:1875839738320128:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788940748.952204:0:19019:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788940748.952249:0:19019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19019:1875839738320256:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788940748.952298:0:19019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940748.952432:0:19019:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f082900e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940748.952773:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320256 00000100:00100000:3.0:1788940748.952780:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320256 00000100:00100000:1.0:1788940748.957899:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940748.957928:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19019:x1875839738320256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788940748.957979:0:19683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1788940748.965052:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:19019:x1875839738320256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7122us (12744us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788940748.965066:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940748.967628:0:19019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19019:1875839738320256:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788940748.967648:0:19019:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:1.0:1788940749.360412:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940750.138562:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788940750.138620:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788940750.380647:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940751.405881:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940752.437302:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940753.454635:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940753.900977:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738320384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940753.901067:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940753.901179:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320384 00000100:00100000:2.0:1788940753.901191:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320384 00000100:00100000:2.0:1788940753.901247:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940753.901256:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738320384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940753.901288:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940753.901331:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738320384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940753.901338:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940753.901376:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788940753.901398:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738320384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940753.901424:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940753.903278:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940753.903284:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788940753.903287:0:37:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940753.903294:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:0.0:1788940753.903299:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788940753.903304:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788940753.903325:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1ae853800 x1875839738320640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940753.903377:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738320640:0@lo:8:kworker.0 00000100:00100000:0.0:1788940753.903445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940753.903501:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940753.903556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940753.903589:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320896 00000100:00100000:0.0:1788940753.903596:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320896 00000100:00100000:0.0:1788940753.903645:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940753.903654:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738320896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940753.903916:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738320512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940753.903952:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940753.903980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940753.903995:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738320768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940753.904019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940753.904063:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738320896:12345-0@lo:400:kworker.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940753.904071:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940753.904086:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320768 00000100:00100000:0.0:1788940753.904089:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320768 00000100:00100000:0.0:1788940753.904106:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940753.904112:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940753.904257:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738320768:12345-0@lo:400:kworker.0 Request processed in 144us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940753.904263:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788940753.904284:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940753.904310:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1ae850700 x1875839738320896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940753.904323:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738320896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940753.911640:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320640 00000100:00100000:2.0:1788940753.911656:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320640 00000100:00100000:2.0:1788940753.911702:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940753.911711:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738320640:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788940753.911731:0:19682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788940753.917731:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738320512 00000100:00100000:1.0:1788940753.917747:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738320512 00000100:00100000:1.0:1788940753.917797:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940753.917807:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3305:x1875839738320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940753.917906:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3305:x1875839738320512:12345-0@lo:400:kworker.0 Request processed in 99us (13952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940753.917913:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788940753.925507:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1ae853100 x1875839738320768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940753.925540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738320768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940753.925556:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738320512:0@lo:400:kworker.0 00000100:00100000:2.0:1788940753.950038:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738320640:12345-0@lo:8:kworker.0 Request processed in 38320us (46598us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940753.950052:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788940753.950252:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940753.950258:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940753.950262:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738320640:0@lo:8:kworker.0 00010000:00010000:0.0:1788940754.480081:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940755.505556:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940756.525620:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940756.848328:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940757.548991:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940757.752849:0:20402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788940757.752854:0:20402:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788940757.756134:0:20402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89f1914c7000 00000020:01000004:0.0:1788940757.756158:0:20402:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788940757.756173:0:20402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788940757.756188:0:20402:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89f1982e4d88) 00000020:00000080:0.0:1788940757.756205:0:20402:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788940757.789557:0:20402:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788940757.789784:0:20402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940757.799201:0:20402:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940757.799459:0:20402:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788940757.801030:0:20402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788940757.801459:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:2.0:1788940757.801603:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1788940757.802046:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1788940757.811193:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 726: rc = 0 00100000:10000000:2.0:1788940757.813008:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 726: rc = 0 00100000:10000000:2.0:1788940757.813302:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 726: rc = 0 00100000:10000000:2.0:1788940757.815050:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 726: rc = 0 00100000:10000000:2.0:1788940757.816087:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 726: rc = 0 00100000:10000000:2.0:1788940757.816858:0:20402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 726: rc = 0 00000020:00000080:2.0:1788940757.819131:0:20402:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788940757.819144:0:20402:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940757.819157:0:20402:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4c4be 00000020:01000004:2.0:1788940757.819165:0:20402:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788940757.819185:0:20402:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940757.819189:0:20402:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940757.819194:0:20402:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788940757.819214:0:20402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788940757.819218:0:20402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788940757.833265:0:20402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940757.834140:0:20402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.114@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788940757.834146:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940757.834148:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940757.834149:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940757.834150:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940757.834151:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940757.834153:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940757.834154:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940757.834156:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940757.834158:0:20402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940757.834161:0:20402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788940757.834164:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940757.834165:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940757.834167:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940757.834167:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940757.834169:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940757.834170:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940757.834171:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940757.834178:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940757.834180:0:20402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940757.834212:0:20402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788940757.834234:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321024:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940757.834508:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940757.835048:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184201300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.838222:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321024 00000100:00100000:2.0:1788940757.838237:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321024 00000100:00100000:2.0:1788940757.838317:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940757.838329:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:20402:x1875839738321024:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940757.838367:0:18991:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788940757.838371:0:18991:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788940757.838375:0:18991:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788940757.849380:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:20402:x1875839738321024:12345-0@lo:253:mount.lustre.0 Request processed in 11043us (14862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.849395:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940757.849921:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940757.849937:0:20402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788940757.849940:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940757.849942:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940757.849943:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940757.849954:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940757.849955:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940757.849956:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940757.849958:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940757.849960:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940757.849961:0:20402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940757.849984:0:20402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89f1914c7000 from lustre-OST0001 10000000:01000000:3.0:1788940757.850013:0:20402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788940757.850016:0:20402:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788940757.850025:0:20402:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89f1b5184d88 local copy 00010000:00010000:3.0:1788940757.850035:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940757.850279:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940757.850336:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940757.850376:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184201000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940757.850766:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321152 00000100:00100000:0.0:1788940757.850774:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321152 00000100:00100000:0.0:1788940757.850822:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940757.850834:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:20402:x1875839738321152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.851013:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+16:20402:x1875839738321152:12345-0@lo:501:mount.lustre.0 Request processed in 182us (676us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940757.851021:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940757.851140:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321152:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788940757.851157:0:20402:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788940757.851313:0:20402:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788940757.851321:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.851336:0:20402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97400/0x27a633fcdd4c248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c24f expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940757.851358:0:20402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89f1914c7000 10000000:01000000:3.0:1788940757.851362:0:20402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940757.851367:0:20402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788940757.851370:0:20402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940757.851374:0:20402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788940757.851377:0:20402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788940757.851617:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.851626:0:20402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.851635:0:20402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940757.851653:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940757.851685:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940757.851749:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f184201000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.862615:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321280 00000100:00100000:2.0:1788940757.862636:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321280 00000100:00100000:3.0:1788940757.862817:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940757.862830:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+16:20402:x1875839738321280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940757.862850:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940757.862872:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa96400/0x27a633fcdd4c4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c4c5 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.862903:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa96400/0x27a633fcdd4c4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c4c5 expref: 17 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.862934:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa96400/0x27a633fcdd4c4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c4c5 expref: 17 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.862943:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96400, rc 0) 00000100:00100000:3.0:1788940757.863052:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321280:12345-0@lo:101:mount.lustre.0 Request processed in 224us (11366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.863060:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788940757.863180:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940757.863199:0:20402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4cc expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.863210:0:20402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c4cc expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940757.864012:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788940757.864879:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940757.865117:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788940757.865154:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788940757.865187:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788940757.865243:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788940757.865273:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788940757.865297:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788940757.865336:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788940757.865366:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788940757.865413:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788940757.865466:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788940757.865474:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788940757.865594:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940757.865671:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.865710:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940757.866261:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321408 00000100:00100000:3.0:1788940757.866270:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321408 00000100:00100000:3.0:1788940757.866326:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788940757.866335:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940757.866747:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321408:12345-0@lo:501:mount.lustre.0 Request processed in 411us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.866755:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940757.874197:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940757.874268:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940757.876644:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.876695:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940757.876848:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321536 00000100:00100000:3.0:1788940757.876858:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321536 00000100:00100000:3.0:1788940757.876911:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940757.876920:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940757.877292:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321536:12345-0@lo:503:mount.lustre.0 Request processed in 372us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.877301:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940757.877661:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940757.878261:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940757.878643:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940757.878704:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.878751:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940757.879032:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321664 00000100:00100000:3.0:1788940757.879039:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321664 00000100:00100000:3.0:1788940757.879084:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940757.879094:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940757.881678:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321664:12345-0@lo:502:mount.lustre.0 Request processed in 2577us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.881712:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788940757.883253:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940757.883626:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788940757.883690:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788940757.883725:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788940757.883772:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788940757.883810:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788940757.883844:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788940757.883904:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788940757.883939:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788940757.883997:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788940757.884044:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940757.884122:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.884160:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940757.884321:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321792 00000100:00100000:0.0:1788940757.884329:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321792 00000100:00100000:0.0:1788940757.884378:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940757.884387:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940757.884641:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321792:12345-0@lo:502:mount.lustre.0 Request processed in 255us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.884650:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940757.886698:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940757.886857:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788940757.886871:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788940757.889652:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940757.889664:0:20403:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788940757.889672:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940757.889674:0:20403:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788940757.889681:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940757.889697:0:20403:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff89f1bf86cd88) 00000020:00000080:3.0:1788940757.889724:0:20403:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788940757.889730:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940757.889794:0:20403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1914c7000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788940757.889802:0:20403:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788940757.889809:0:20403:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27a633fcdd4c4da 00010000:00010000:3.0:1788940757.902270:0:20403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788940757.906868:0:20403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:3.0:1788940757.909314:0:20403:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1788940757.919092:0:20403:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788940757.919105:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.919112:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.919114:0:20403:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788940757.919118:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940757.919122:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.919123:0:20403:0:(obd_config.c:1662:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940757.919126:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940757.919128:0:20403:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788940757.919130:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.919132:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.919133:0:20403:0:(obd_config.c:1662:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788940757.919135:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940757.919142:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.919143:0:20403:0:(obd_config.c:1662:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940757.919147:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788940757.919207:0:20403:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.919210:0:20403:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.919211:0:20403:0:(obd_config.c:1662:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940757.919214:0:20403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788940757.924550:0:20402:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788940757.924594:0:20402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940757.924617:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4cc expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.924643:0:20402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f1bfa96200/0x27a633fcdd4c4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4cc expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940757.924652:0:20402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1914c7000 from 1 10000000:01000000:1.0:1788940757.924655:0:20402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940757.924695:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.924701:0:20402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.924712:0:20402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940757.924738:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940757.924800:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.924834:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940757.926281:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738321920 00000100:00100000:3.0:1788940757.926294:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738321920 00000100:00100000:3.0:1788940757.926356:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940757.926366:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:20402:x1875839738321920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940757.926384:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940757.926401:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c4e1 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.926614:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.926642:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940757.926652:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97800, rc 0) 00000100:00100000:3.0:1788940757.926766:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738321920:12345-0@lo:101:mount.lustre.0 Request processed in 402us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.926772:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940757.927497:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738321920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940757.927714:0:20402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.927725:0:20402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940757.929264:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1788940757.930511:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940757.931079:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788940757.931129:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788940757.931249:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788940757.931285:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788940757.931320:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788940757.931369:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788940757.931407:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788940757.931515:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788940757.931741:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788940757.931750:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1788940757.931840:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.931905:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.932004:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940757.932046:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322048 00000100:00100000:1.0:1788940757.932053:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322048 00000100:00100000:1.0:1788940757.932132:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940757.932142:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940757.932356:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322048:12345-0@lo:501:mount.lustre.0 Request processed in 215us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.932364:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940757.932436:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.932464:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940757.932500:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.932895:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.932968:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322176 00000100:00100000:2.0:1788940757.932982:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322176 00000100:00100000:2.0:1788940757.933008:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940757.933015:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940757.933168:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322176:12345-0@lo:503:mount.lustre.0 Request processed in 140us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.933174:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788940757.933364:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322176:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940757.934005:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940757.934068:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940757.934117:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.934138:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.934337:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322304 00000100:00100000:2.0:1788940757.934343:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322304 00000100:00100000:2.0:1788940757.934369:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940757.934377:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940757.934613:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322304:12345-0@lo:502:mount.lustre.0 Request processed in 236us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.934620:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788940757.934753:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940757.934975:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788940757.935020:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788940757.935066:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788940757.935120:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788940757.935232:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788940757.935291:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788940757.935328:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788940757.935363:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788940757.935393:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940757.935501:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.935549:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.935611:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322432 00000100:00100000:2.0:1788940757.935618:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322432 00000100:00100000:2.0:1788940757.935654:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940757.935662:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940757.935804:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322432:12345-0@lo:502:mount.lustre.0 Request processed in 142us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.935812:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940757.935937:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940757.936027:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788940757.936036:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788940757.937123:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940757.937133:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.937135:0:20407:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788940757.937141:0:20407:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1914c7000 00000020:00000080:0.0:1788940757.937143:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940757.937150:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.937152:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.937153:0:20407:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788940757.937222:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940757.937226:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.937227:0:20407:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940757.937230:0:20407:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff89f1914c7000 00000020:00000080:0.0:1788940757.937240:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940757.937319:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.937323:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.937325:0:20407:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788940757.937328:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940757.937331:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.937332:0:20407:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940757.937335:0:20407:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89f1914c7000 00000020:00000080:0.0:1788940757.937337:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940757.939764:0:20407:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940757.939775:0:20407:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940757.939777:0:20407:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788940757.939782:0:20407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788940757.940015:0:20402:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788940757.940043:0:20402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940757.940069:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.940081:0:20402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940757.940124:0:20402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940757.940127:0:20402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89f1914c7000 10000000:01000000:1.0:1788940757.940130:0:20402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89f1914c7000 10000000:01000000:1.0:1788940757.940133:0:20402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940757.940138:0:20402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89f1914c7000 from 1 10000000:01000000:1.0:1788940757.940141:0:20402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940757.940188:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.940212:0:20402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940757.940223:0:20402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940757.940246:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940757.940310:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.940348:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862e4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940757.940565:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322560 00000100:00100000:2.0:1788940757.940574:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322560 00000100:00100000:2.0:1788940757.940617:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940757.940626:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738322560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940757.940640:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940757.940653:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f181520e00/0x27a633fcdd4c4f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c4ef expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940757.940687:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f181520e00/0x27a633fcdd4c4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c4ef expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940757.940698:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f181520e00/0x27a633fcdd4c4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c4ef expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940757.940708:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f181520e00, rc 0) 00000100:00100000:2.0:1788940757.940758:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322560:12345-0@lo:101:mount.lustre.0 Request processed in 133us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.940765:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940757.941577:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940757.941595:0:20402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4f6 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940757.941607:0:20402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c4f6 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940757.943365:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788940757.943985:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940757.947397:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788940757.947569:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788940757.947609:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788940757.947659:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788940757.947693:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788940757.947740:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788940757.947778:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788940757.947833:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788940757.947884:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788940757.947919:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788940757.947979:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788940757.948030:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788940757.948069:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788940757.948104:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788940757.950786:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788940757.950899:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788940757.950934:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788940757.951019:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788940757.951059:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788940757.951095:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788940757.951144:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788940757.954717:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788940757.954792:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788940757.954883:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788940757.954920:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788940757.954966:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788940757.955015:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788940757.955051:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788940757.955083:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788940757.955127:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788940757.956722:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788940757.956796:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788940757.956832:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788940757.956915:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788940757.956968:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788940757.957019:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788940757.957055:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788940757.957090:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788940757.957139:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788940757.957310:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788940757.957476:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788940757.957486:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788940757.957615:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.957686:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.973045:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322688 00000100:00100000:0.0:1788940757.973059:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322688 00000100:00100000:0.0:1788940757.973110:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940757.973120:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.973589:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322688:12345-0@lo:501:mount.lustre.0 Request processed in 469us (15900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.973608:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940757.973679:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940757.973704:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940757.973754:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940757.973801:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.973824:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940757.974245:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322816 00000100:00100000:1.0:1788940757.974251:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322816 00000100:00100000:1.0:1788940757.974291:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940757.974300:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940757.974672:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322816:12345-0@lo:503:mount.lustre.0 Request processed in 372us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.974679:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940757.977313:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940757.978093:0:20402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940757.978511:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940757.979107:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.979144:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940757.981660:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738322944 00000100:00100000:1.0:1788940757.981674:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738322944 00000100:00100000:1.0:1788940757.981733:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940757.981744:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940757.982043:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738322944:12345-0@lo:502:mount.lustre.0 Request processed in 301us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.982051:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940757.984810:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738322944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940757.989231:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788940757.989337:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788940757.989383:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788940757.989441:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788940757.989479:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788940757.989548:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788940757.989584:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788940757.989654:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788940757.989704:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788940757.989739:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788940757.989773:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788940757.989836:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788940757.989877:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788940757.989910:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788940757.989969:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788940757.990003:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788940757.990035:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788940757.990077:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788940757.990113:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788940757.990148:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788940757.990194:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788940757.990229:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788940757.990264:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788940757.990328:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788940757.990368:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788940757.990403:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788940757.990453:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788940757.990491:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788940757.990544:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788940757.990592:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788940757.990624:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788940757.990655:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788940757.990689:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788940757.990736:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788940757.990782:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788940757.990830:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788940757.990864:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788940757.990897:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788940757.990941:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788940757.991015:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788940757.991073:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738323072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940757.991153:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.991205:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f181370cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940757.991666:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323072 00000100:00100000:0.0:1788940757.991675:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323072 00000100:00100000:0.0:1788940757.991728:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940757.991739:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738323072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940757.991991:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738323072:12345-0@lo:502:mount.lustre.0 Request processed in 253us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.992000:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940757.993139:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738323072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940757.993270:0:20402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788940757.993283:0:20402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788940757.996731:0:20412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788940757.996774:0:20412:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89f08183cd88) 00000020:00000080:1.0:1788940757.996803:0:20412:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788940757.996886:0:20412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89f1914c7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940757.996891:0:20412:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89f1914c7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940757.996893:0:20412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89f1914c7000 3 00010000:00080000:1.0:1788940757.996927:0:20412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89f1b8970800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788940758.004704:0:20412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788940758.004931:0:20412:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788940758.004980:0:20412:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940758.004993:0:20412:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27a633fcdd4c504 00000100:00080000:1.0:1788940758.005013:0:20412:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940758.005020:0:20412:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89f1b8970800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788940758.005059:0:20412:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b5c6d500 x1875839738323200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940758.010577:0:20412:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940758.010800:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940758.010805:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940758.010808:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940758.010816:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 696 00000100:00080000:2.0:1788940758.010821:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788940758.010827:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788940758.010849:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f1b4cd1500 x1875839738323456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940758.010911:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738323584:0@lo:400:kworker.0 00000100:00100000:2.0:1788940758.010998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940758.011037:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940758.011045:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738323712:0@lo:400:kworker.0 00000100:00100000:2.0:1788940758.011077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940758.011409:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738323328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940758.011453:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788940758.011825:0:20412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:2.0:1788940758.013010:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323328 00000100:00100000:2.0:1788940758.013022:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323328 00000100:00100000:2.0:1788940758.013097:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940758.013107:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940758.013204:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738323328:12345-0@lo:400:kworker.0 Request processed in 99us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940758.013212:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1788940758.013238:0:20402:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788940758.013278:0:20402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940758.013293:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4f6 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.013304:0:20402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad3200/0x27a633fcdd4c4ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c4f6 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940758.013353:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940758.013355:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940758.013357:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940758.013358:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940758.013359:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940758.013361:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940758.013362:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940758.013365:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940758.013366:0:20402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940758.013369:0:20402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788940758.013371:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940758.013373:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940758.013373:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940758.013374:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940758.013375:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940758.013376:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940758.013377:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940758.013400:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940758.013401:0:20402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940758.013803:0:20402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788940758.013821:0:20402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738323840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940758.013862:0:20402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940758.013888:0:20402:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1862ea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940758.013932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738323328:0@lo:400:kworker.0 00000100:00080000:1.0:1788940758.014261:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940758.014282:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323840 00000100:00100000:1.0:1788940758.014293:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323840 00000100:00100000:1.0:1788940758.014333:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940758.014342:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:20402:x1875839738323840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788940758.014362:0:18989:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788940758.014376:0:18989:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788940758.016643:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738323200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788940758.017241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940758.017292:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738323456:0@lo:8:kworker.0 00000100:00100000:1.0:1788940758.017321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940758.018069:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323584 00000100:00100000:2.0:1788940758.018080:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323584 00000100:00100000:2.0:1788940758.018115:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323712 00000100:00100000:2.0:1788940758.018118:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323712 00000100:00100000:2.0:1788940758.018147:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323200 00000100:00100000:2.0:1788940758.018150:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323200 00000100:00100000:2.0:1788940758.018175:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940758.018184:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940758.018249:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738323584:12345-0@lo:400:kworker.0 Request processed in 67us (7252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940758.018257:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940758.018273:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940758.018279:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940758.018308:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738323712:12345-0@lo:400:kworker.0 Request processed in 30us (7230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940758.018314:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940758.018325:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940758.018329:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875839738323200:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788940758.018349:0:18997:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:2.0:1788940758.018392:0:18997:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27a633fcdd4c50b 00000004:00100000:2.0:1788940758.018682:0:18997:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788940758.019328:0:18997:0:(import.c:65:import_set_state_nolock()) ffff89f1b5c5b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940758.019408:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875839738323200:12345-0@lo:38:llog_process_th.0 Request processed in 1075us (2167us total) trans 0 rc 0/0 00000100:00080000:1.0:1788940758.019582:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940758.020282:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940758.020319:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323456 00000100:00100000:2.0:1788940758.020325:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323456 00000100:00100000:2.0:1788940758.020360:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940758.020374:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738323456:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788940758.020938:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738323456:12345-0@lo:8:kworker.0 Request processed in 560us (3613us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788940758.020955:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788940758.023056:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd2300 x1875839738323712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940758.023075:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738323712:0@lo:400:kworker.0 00010000:00080000:2.0:1788940758.023089:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b4cd3b80 x1875839738323584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940758.023099:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738323584:0@lo:400:kworker.0 00010000:00080000:2.0:1788940758.024255:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89f1b5c6d500 x1875839738323200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940758.024269:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940758.024282:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788940758.024293:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788940758.024299:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788940758.024303:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f1b8970800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788940758.024311:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875839738323200:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940758.024349:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940758.024352:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940758.024356:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788940758.024359:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738323456:0@lo:8:kworker.0 20000000:01000000:1.0:1788940758.082001:0:18989:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940758.082017:0:18989:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788940758.082876:0:19012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940758.082882:0:19012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940758.082904:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940758.082923:0:19012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940758.082932:0:19012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940758.082983:0:19012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940758.082999:0:19012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 19 pid: 18990 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940758.083013:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738323968:0@lo:104: 00000100:00100000:0.0:1788940758.083076:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940758.083172:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1b4c860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940758.085283:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738323968 00000100:00100000:3.0:1788940758.085298:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738323968 00000100:00100000:3.0:1788940758.085401:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940758.085562:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738323968:12345-0@lo:104: 00010000:00010000:3.0:1788940758.085579:0:18980:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940758.085686:0:18980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940758.085693:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:19012:x1875839738323968:12345-0@lo:104: Request processed in 284us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940758.085700:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940758.086041:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19012:1875839738323968:0@lo:104: 00010000:00010000:0.0:1788940758.086068:0:19012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086783:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940758.086792:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086801:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:2.0:1788940758.086806:0:18984:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086815:0:18984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940758.086822:0:18984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940758.086829:0:18984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940758.086877:0:18984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086884:0:18984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940758.086917:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086924:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181520000/0x27a633fcdd4c3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c3c9 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.086951:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940758.086966:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940758.086968:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940758.086976:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940758.086994:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738324096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940758.087056:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940758.087110:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324096 00000100:00100000:2.0:1788940758.087117:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324096 00010000:00010000:2.0:1788940758.087140:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 20 pid: 18990 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940758.087240:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940758.087248:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+20:3308:x1875839738324096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940758.087260:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940758.087265:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 20 pid: 18990 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087276:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 20 pid: 18990 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087291:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c3c2 expref: 20 pid: 18990 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087306:0:18981:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087315:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940758.087330:0:18981:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004448381s 00010000:00010000:2.0:1788940758.087335:0:18981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087351:0:18981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087357:0:18981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087363:0:18981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087380:0:18981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940758.087385:0:18981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087392:0:18981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087562:0:18981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087572:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940758.087831:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3308:x1875839738324096:12345-0@lo:103:ldlm_bl.0 Request processed in 583us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940758.087839:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788940758.087868:0:19012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087876:0:19012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940758.087882:0:19012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c512 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940758.088099:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738324096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940758.099039:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:20402:x1875839738323840:12345-0@lo:253:mount.lustre.0 Request processed in 84689us (85167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940758.099054:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940758.099139:0:20402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7833fd5-ba21-4794-9436-ab89d07c3023:20402:1875839738323840:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940758.099232:0:20402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788940758.099236:0:20402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940758.099238:0:20402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940758.099239:0:20402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940758.099240:0:20402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940758.099241:0:20402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940758.099243:0:20402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940758.099245:0:20402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940758.099247:0:20402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940758.099248:0:20402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940758.099267:0:20402:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788940758.112107:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940758.112357:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940758.112852:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940758.113030:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940758.113201:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940758.114084:0:20402:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788940758.121337:0:20402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788940758.242175:0:20402:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788940758.242185:0:20402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788940758.242216:0:20402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940758.242286:0:20402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940758.242301:0:20402:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788940758.242331:0:20402:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788940758.575556:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940759.025925:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738324224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940759.026007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940759.026119:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324224 00000100:00100000:2.0:1788940759.026127:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324224 00000100:00100000:2.0:1788940759.026178:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940759.026188:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738324224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940759.026224:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940759.026276:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738324224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.026283:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940759.026387:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738324224:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788940759.212652:0:18993:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940759.212659:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89f1bee49000 from 11 10000000:01000000:0.0:1788940759.212676:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940759.212732:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940759.212744:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940759.212755:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940759.212782:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738324352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940759.212850:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.212904:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1baa6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940759.212978:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324352 00000100:00100000:3.0:1788940759.212986:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324352 00000100:00100000:3.0:1788940759.213038:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940759.213048:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738324352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940759.213059:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940759.213072:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97c00/0x27a633fcdd4c520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c519 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940759.213094:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97c00/0x27a633fcdd4c520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c519 expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940759.213105:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97c00/0x27a633fcdd4c520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c519 expref: 19 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940759.213113:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97c00, rc 0) 00000100:00100000:3.0:1788940759.213165:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738324352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940759.213172:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940759.213216:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738324352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940759.213230:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c520 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940759.213238:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c520 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940759.213287:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738324480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788940759.213325:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.213337:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f191f14d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940759.213662:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324480 00000100:00100000:0.0:1788940759.213667:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324480 00000100:00100000:0.0:1788940759.213706:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940759.213714:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738324480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788940759.213728:0:18991:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940759.213749:0:18991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940759.213753:0:18991:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788940759.213842:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738324480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.213850:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940759.213928:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738324480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940759.214003:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940759.214010:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c520 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940759.214018:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f0812ea000/0x27a633fcdd4c519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c520 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940759.598267:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940760.620869:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940761.644805:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940762.681295:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940763.116941:0:38:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940763.116947:0:38:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940763.116951:0:38:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940763.116962:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89f192366800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788940763.116983:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89f0821c3b80 x1875839738324864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940763.117054:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738324736:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.117115:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.117165:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788940763.117170:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7833fd5-ba21-4794-9436-ab89d07c3023:3306:1875839738324608:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.117194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.117213:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738325248:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.117238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.117259:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738324992:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.117277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.117291:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940763.117294:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738325120:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.117309:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.117336:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324736 00000100:00100000:3.0:1788940763.117343:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324736 00000100:00100000:1.0:1788940763.117457:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325248 00000100:00100000:1.0:1788940763.117473:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325248 00000100:00100000:1.0:1788940763.118002:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324992 00000100:00100000:1.0:1788940763.118007:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324992 00000100:00100000:1.0:1788940763.118023:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325120 00000100:00100000:1.0:1788940763.118025:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325120 00000100:00100000:1.0:1788940763.118042:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940763.118050:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738325248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940763.118111:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738325248:12345-0@lo:400:kworker.0 Request processed in 61us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940763.118117:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940763.118133:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940763.118138:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940763.118170:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738324992:12345-0@lo:400:kworker.0 Request processed in 32us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940763.118176:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940763.118188:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940763.118194:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940763.118219:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738325120:12345-0@lo:400:kworker.0 Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940763.118225:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940763.118243:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324608 00000100:00100000:1.0:1788940763.118247:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324608 00000100:00100000:1.0:1788940763.118272:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940763.118278:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3306:x1875839738324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940763.118306:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3306:x1875839738324608:12345-0@lo:400:kworker.0 Request processed in 28us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940763.118312:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788940763.118904:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940763.118946:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c1f80 x1875839738325120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940763.118961:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738325120:0@lo:400:kworker.0 00010000:00080000:1.0:1788940763.118972:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c3100 x1875839738324992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940763.118981:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738324992:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.119244:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940763.119254:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738324736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.119295:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738324736:12345-0@lo:400:kworker.0 Request processed in 43us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940763.119309:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788940763.119327:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940763.119346:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7833fd5-ba21-4794-9436-ab89d07c3023:3306:1875839738324608:0@lo:400:kworker.0 00000100:00100000:2.0:1788940763.119454:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738324864:0@lo:8:kworker.0 00000100:00100000:2.0:1788940763.119500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940763.119551:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738324864 00000100:00100000:2.0:1788940763.119555:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738324864 00000100:00100000:2.0:1788940763.119755:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940763.119761:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875839738324864:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788940763.119796:0:19682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:2.0:1788940763.119823:0:19682:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27a633fcdd4c527 00002000:00100000:2.0:1788940763.119836:0:19682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89f1bee9e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788940763.119841:0:19682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788940763.119844:0:19682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788940763.120190:0:19682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940763.120213:0:19682:0:(import.c:65:import_set_state_nolock()) ffff89f1bee99000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940763.120255:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875839738324864:12345-0@lo:8:kworker.0 Request processed in 492us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940763.120262:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788940763.120776:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c2300 x1875839738325248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940763.120788:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738325248:0@lo:400:kworker.0 00000100:00100000:3.0:1788940763.120799:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738324736:0@lo:400:kworker.0 00010000:00080000:3.0:1788940763.120845:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f0821c3b80 x1875839738324864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940763.120856:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788940763.120863:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788940763.120869:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788940763.120871:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89f192366800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788940763.120881:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788940763.120885:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875839738324864:0@lo:8:kworker.0 00000004:00080000:1.0:1788940763.121781:0:19021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1788940763.121806:0:19021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19021:1875839738325504:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788940763.121852:0:19021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940763.121874:0:19021:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f198614840 going to sleep for 11 seconds 00000004:00080000:1.0:1788940763.121891:0:19020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788940763.122283:0:19020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706020763792ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788940763.122310:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940763.122321:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738325376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940763.122350:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940763.123308:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325504 00000100:00100000:2.0:1788940763.123317:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325504 00000100:00100000:2.0:1788940763.123378:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940763.123386:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19021:x1875839738325504:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788940763.123849:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940763.125245:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325376 00000100:00100000:3.0:1788940763.125254:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325376 00000100:00100000:3.0:1788940763.125297:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940763.125305:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738325376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940763.125333:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940763.125860:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875839738325376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 555us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940763.125869:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788940763.128833:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b5c6c700 x1875839738325376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940763.128859:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738325376:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788940763.147883:0:19683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788940763.147893:0:19683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788940763.147911:0:19683:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:2.0:1788940763.183496:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.183511:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.183544:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.183549:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.183556:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.183574:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.187858:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.187867:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.187916:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940763.192588:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.192604:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.192619:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.192624:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.192634:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.192687:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.192695:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0fd90c5/0x27a633fcdd4c52e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.192723:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.192725:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.192727:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.196338:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.198513:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.198546:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.198551:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.198557:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.198572:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.198973:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.198981:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.199032:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940763.200691:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.200701:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.200711:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181520200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.200716:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.200725:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.200742:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.200750:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345e0dc0/0x27a633fcdd4c535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.200783:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.200785:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.200786:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.201149:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.201155:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.201166:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.201169:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.201174:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.201184:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.201192:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.201199:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.201221:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940763.201819:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.201825:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.201833:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.201837:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.201845:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.201857:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.201864:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ffd6a0/0x27a633fcdd4c53c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.201879:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.201880:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.201882:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.202249:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.202255:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.202264:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.202275:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.202279:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.202289:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.202297:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.202303:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.203344:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.207138:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.207148:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.207165:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.207170:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.207177:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.207192:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.207202:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.207217:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208837:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940763.208849:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208872:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.208876:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208887:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208915:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208923:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9168ee8/0x27a633fcdd4c543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208942:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.208946:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208952:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.208955:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208962:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208971:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.208985:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.208986:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.208988:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.219075:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.219079:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940763.219091:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec3ae40b/0x27a633fcdd4c54a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940763.219859:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.219867:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.219880:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.219885:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.219891:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.219918:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.219927:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.219934:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.220735:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.221992:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.222422:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.222439:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.222443:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.222449:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.222461:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.222471:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.222479:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.236870:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940763.236885:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.236911:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940763.236916:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.236929:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.236955:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.236964:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc12268/0x27a633fcdd4c551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.239753:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.240420:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.240431:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240447:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.240459:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.240466:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240479:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240490:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240499:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240508:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940763.240920:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.240926:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240934:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.240937:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.240941:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240949:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240957:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240970:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.240977:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788940763.241331:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.241337:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241345:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.241348:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.241352:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241361:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241369:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241376:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241384:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788940763.241767:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.241773:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241786:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.241789:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.241793:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241802:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241810:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241817:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.241826:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788940763.242195:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.242201:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242209:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.242213:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.242216:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242224:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242243:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242251:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242258:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788940763.242631:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.242637:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242645:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.242648:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.242651:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242659:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242666:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242672:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.242691:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1788940763.244015:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788940763.244026:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244037:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244042:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244052:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244070:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244077:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a778f9/0x27a633fcdd4c558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244100:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788940763.244103:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244109:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244125:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244133:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244142:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244148:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db3990e/0x27a633fcdd4c55f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244162:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788940763.244165:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244171:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244174:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244181:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244188:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244194:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b503d926/0x27a633fcdd4c566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244212:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788940763.244216:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244222:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244225:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244232:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244241:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244248:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9bf3a7a/0x27a633fcdd4c56d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244259:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940763.244261:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244267:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244270:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244287:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244296:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244304:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b21c99/0x27a633fcdd4c574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244315:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940763.244318:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244324:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244327:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244333:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244341:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244347:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877811ff/0x27a633fcdd4c57b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244368:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.244372:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244379:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.244382:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244389:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244399:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244405:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159b013e/0x27a633fcdd4c582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.244416:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.244418:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.244420:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.250794:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.250809:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.250826:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.250830:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.250837:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.250851:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.250861:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.250870:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.250908:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.251371:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.251377:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251386:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.251395:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.251400:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251409:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251418:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251425:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251434:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940763.251826:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.251833:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251843:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.251846:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.251851:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251860:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251867:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251880:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.251887:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788940763.252280:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.252286:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252294:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.252298:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.252302:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252311:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252320:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252327:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252336:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788940763.252716:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.252722:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252735:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.252738:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.252742:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252750:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252758:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252765:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.252774:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788940763.253141:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.253147:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253155:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.253159:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.253163:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253172:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253192:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253198:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253206:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788940763.253652:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.253657:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253666:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.253668:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.253672:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253680:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253687:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253694:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.253710:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1788940763.256582:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788940763.256595:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256609:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256614:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256642:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256666:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256674:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bddb6bab/0x27a633fcdd4c589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256702:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788940763.256706:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256714:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256717:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256723:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256733:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256739:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b2ce75/0x27a633fcdd4c590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256764:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788940763.256767:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256774:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256776:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256783:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256792:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256798:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f35f57a/0x27a633fcdd4c597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256809:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940763.256812:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256817:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d7a00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256820:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256836:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256846:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256852:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc330c2b/0x27a633fcdd4c59e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256864:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940763.256867:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256874:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256876:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256884:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256903:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256910:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fee3a5e3/0x27a633fcdd4c5a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256935:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940763.256938:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256945:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1846d6400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256948:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256956:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256967:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256974:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087cbe626/0x27a633fcdd4c5ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256984:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940763.256988:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.256994:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.256997:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.257016:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.257025:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.257032:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000811a1bb2/0x27a633fcdd4c5b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.257044:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940763.257046:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940763.257048:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.257381:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.257384:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.257385:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.266415:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.266427:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266445:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.266449:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.266456:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266471:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266480:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266487:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266506:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940763.266539:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940763.266545:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266553:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.266563:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266573:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266591:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266598:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.266613:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.266615:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.266617:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.267086:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.267092:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267101:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.267105:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.267108:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267118:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267125:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267140:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267153:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.267512:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.267539:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267548:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.267551:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.267555:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267564:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267572:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267579:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267591:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940763.267601:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940763.267605:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267617:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.267621:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267629:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267640:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267648:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000108c2598/0x27a633fcdd4c5c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267661:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940763.267664:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267670:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477be00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.267673:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267679:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267688:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267700:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282f6855/0x27a633fcdd4c5c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.267712:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.267714:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.267715:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.268106:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.268112:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268121:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.268124:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.268128:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268136:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268144:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268152:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268166:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940763.268174:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940763.268183:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268190:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477aa00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.268193:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268199:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268209:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268216:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de499a5/0x27a633fcdd4c5cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.268228:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.268230:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.268232:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940763.271577:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.276300:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.276314:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.276332:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.276337:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.276343:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940763.282597:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788940763.283499:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283511:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283540:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283559:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940763.283575:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940763.283580:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283588:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.283592:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283601:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283617:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283625:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c5d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.283654:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.283657:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.283659:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.284257:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.284263:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284276:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.284280:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.284286:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284295:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284302:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284309:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284330:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.284817:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.284823:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284842:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.284845:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.284850:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284860:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284867:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284874:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284889:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940763.284913:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940763.284918:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284925:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477ae00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.284928:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284937:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284960:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284967:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a5addbe/0x27a633fcdd4c5dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284980:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940763.284983:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.284989:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940763.284993:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.285103:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.285242:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.285253:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.285262:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c2b0660/0x27a633fcdd4c5e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.285274:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.285276:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.285284:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940763.286319:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.286325:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.286336:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.286340:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.286345:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.286840:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.286849:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.286856:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.286912:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940763.287414:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.287421:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.287430:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.287433:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.287437:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.287457:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.287465:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.287471:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293125:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940763.293137:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293164:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.293169:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293181:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293203:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293211:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c5eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293232:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.293237:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293243:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a000 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.293247:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293255:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293265:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.293277:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.293279:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.293281:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.296683:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940763.296698:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba64cb8/0x27a633fcdd4c5f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940763.297340:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940763.297471:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.297486:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=706s v=(0 0) 00010000:00010000:2.0:1788940763.297491:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940763.297498:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.297513:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.297677:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940763.297686:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.298833:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940763.298843:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.298855:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477bc00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940763.298859:0:18984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.298870:0:18984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.298889:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940763.298924:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940763.298926:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940763.298928:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940763.302241:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940763.302255:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b305182d/0x27a633fcdd4c5f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940763.309871:0:19683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788940763.309885:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.309930:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=706s v=(0 0) 00010000:00010000:3.0:1788940763.309935:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940763.309941:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.309955:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.309965:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940763.309973:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.315076:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940763.315092:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.315106:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97200 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940763.315112:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.315122:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.315142:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940763.315151:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.315153:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940763.315154:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.318308:0:19683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788940763.318323:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009559d833/0x27a633fcdd4c600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788940763.318830:0:19683:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1788940763.318937:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19021:x1875839738325504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 195546us (197079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940763.318947:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940763.320662:0:19021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5c6d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19021:1875839738325504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788940763.320679:0:19021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:3.0:1788940763.320726:0:19021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19021:1875839738325632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788940763.320771:0:19021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940763.320817:0:19021:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190120000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940763.321623:0:19682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325632 00000100:00100000:3.0:1788940763.321637:0:19682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325632 00000100:00100000:3.0:1788940763.321691:0:19682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940763.321699:0:19682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19021:x1875839738325632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788940763.321741:0:19682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:2.0:1788940763.325477:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940763.338207:0:19682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:19021:x1875839738325632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16501us (17429us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788940763.338220:0:19682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940763.339147:0:19021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19021:1875839738325632:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788940763.339164:0:19021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:1.0:1788940763.704166:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940763.776824:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788940763.776838:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000100:00100000:0.0:1788940764.141263:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940764.141285:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738325760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940764.141360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940764.141424:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325760 00000100:00100000:0.0:1788940764.141432:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325760 00000100:00100000:0.0:1788940764.141476:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940764.141485:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738325760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940764.141541:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940764.141587:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875839738325760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940764.141594:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940764.141636:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875839738325760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940764.725302:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940765.747731:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940766.064911:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940766.765680:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940767.791408:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940768.013334:0:20759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788940768.236882:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738325888:0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.236889:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738326272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940768.236924:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738326016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940768.238903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940768.238904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940768.238965:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738326400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940768.238996:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940768.239029:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738326144:0@lo:400:kworker.0 00000100:00100000:0.0:1788940768.239037:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738325888 00000100:00100000:0.0:1788940768.239044:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738325888 00000100:00100000:2.0:1788940768.239055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940768.239078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738326656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940768.239092:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940768.239097:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940768.239104:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3308:x1875839738325888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.239113:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940768.239127:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738326528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.239149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940768.239188:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326400 00000100:00100000:2.0:1788940768.239192:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326400 00000100:00100000:2.0:1788940768.239212:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326656 00000100:00100000:2.0:1788940768.239214:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326656 00000100:00100000:2.0:1788940768.239230:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326528 00000100:00100000:2.0:1788940768.239232:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326528 00000100:00100000:2.0:1788940768.239243:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940768.239249:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738326400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.239287:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738326400:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940768.239293:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940768.239311:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940768.239316:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738326656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.239342:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738326656:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940768.239348:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940768.239361:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940768.239366:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738326528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.239386:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875839738326528:12345-0@lo:400:kworker.0 Request processed in 21us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940768.239392:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940768.239411:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3308:x1875839738325888:12345-0@lo:400:kworker.0 Request processed in 309us (514us total) trans 0 rc 0/0 00000100:00080000:2.0:1788940768.239414:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940768.239426:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788940768.239442:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ba974a80 x1875839738326528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940768.239456:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875839738326528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940768.239474:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738325888:0@lo:400:kworker.0 00010000:00080000:2.0:1788940768.239481:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1ba976d80 x1875839738326656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788940768.239491:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89f1b4cd1500 x1875839738326400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940768.239492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738326656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940768.239508:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940768.239921:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326272 00000100:00100000:1.0:1788940768.239927:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326272 00000100:00100000:1.0:1788940768.239975:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326144 00000100:00100000:1.0:1788940768.239978:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326144 00000100:00100000:1.0:1788940768.239995:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940768.240002:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738326272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940768.240043:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738326272:12345-0@lo:400:kworker.0 Request processed in 42us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940768.240049:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940768.240060:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940768.240065:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738326144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940768.240088:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738326144:12345-0@lo:400:kworker.0 Request processed in 24us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940768.240094:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788940768.240697:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940768.240702:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940768.240731:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738326144:0@lo:400:kworker.0 00000100:00100000:2.0:1788940768.240834:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788940768.240843:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738326272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940768.241468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940768.246910:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326016 00000100:00100000:0.0:1788940768.246924:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326016 00000100:00100000:0.0:1788940768.246970:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940768.246979:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738326016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940768.247013:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940768.247090:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738326016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (5623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940768.247096:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940768.247147:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738326016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940768.818826:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940769.261733:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940769.261804:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940769.261907:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326784 00000100:00100000:0.0:1788940769.261914:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326784 00000100:00100000:0.0:1788940769.261972:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940769.261983:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940769.262031:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940769.262083:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.262090:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940769.262154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738326784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940769.837405:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940770.467917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.469574:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400640 00000100:00100000:1.0:1788940770.469587:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400640 00000100:00100000:1.0:1788940770.469639:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:1.0:1788940770.469647:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1875839718400640:12345-192.168.202.14@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788940770.469674:0:18989:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e98e7af8-38de-4d12-88f8-5d012de21ab3@192.168.202.14@tcp t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788940770.469698:0:18989:0:(genops.c:1393:class_connect()) connect: client e98e7af8-38de-4d12-88f8-5d012de21ab3, cookie 0x27a633fcdd4c607 00000100:00080000:1.0:1788940770.469855:0:18989:0:(import.c:65:import_set_state_nolock()) ffff89f191e36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940770.469931:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+5:2349:x1875839718400640:12345-192.168.202.14@tcp:250:mount.lustre.0 Request processed in 283us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.469946:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:3.0:1788940770.482579:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.482888:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400768 00000100:00100000:0.0:1788940770.482899:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400768 00000100:00100000:0.0:1788940770.483014:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:0.0:1788940770.483024:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+5:16804:x1875839718400768:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940770.483040:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940770.483057:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eaa00/0x27a633fcdd4c60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5cf9 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.483085:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eaa00/0x27a633fcdd4c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cf9 expref: 6 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.483095:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eaa00/0x27a633fcdd4c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5cf9 expref: 6 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.483104:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eaa00, rc 0) 00000100:00100000:0.0:1788940770.483492:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+6:16804:x1875839718400768:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 468us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.483500:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:2.0:1788940770.493501:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.493753:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718400896 00000100:00100000:0.0:1788940770.493763:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718400896 00000100:00100000:0.0:1788940770.493818:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:0.0:1788940770.493836:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+6:16804:x1875839718400896:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940770.494554:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+6:16804:x1875839718400896:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 724us (1058us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940770.494563:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:3.0:1788940770.501134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.504367:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401024 00000100:00100000:1.0:1788940770.504384:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401024 00000100:00100000:1.0:1788940770.504544:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788940770.504555:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+6:16804:x1875839718401024:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940770.504573:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940770.504601:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4c615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d00 expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940770.504755:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d00 expref: 7 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940770.504768:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f082ad3e00/0x27a633fcdd4c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d00 expref: 7 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940770.504776:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3e00, rc 0) 00000100:00100000:1.0:1788940770.504862:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+7:16804:x1875839718401024:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 308us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.504869:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788940770.525124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.525233:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401152 00000100:00100000:0.0:1788940770.525249:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401152 00000100:00100000:0.0:1788940770.525326:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:0.0:1788940770.525362:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+7:16804:x1875839718401152:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940770.525684:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16804:x1875839718401152:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 324us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.525693:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:3.0:1788940770.539688:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.540043:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401280 00000100:00100000:1.0:1788940770.540065:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401280 00000100:00100000:1.0:1788940770.540181:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:1.0:1788940770.540192:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16804:x1875839718401280:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940770.540511:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16804:x1875839718401280:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 321us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.540560:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:3.0:1788940770.547442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940770.547570:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401408 00000100:00100000:2.0:1788940770.547586:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401408 00000100:00100000:2.0:1788940770.547660:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:2.0:1788940770.547671:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b592e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16822:x1875839718401408:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940770.548242:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b592e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16822:x1875839718401408:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 572us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940770.548252:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:3.0:1788940770.601156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.601268:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401536 00000100:00100000:1.0:1788940770.601292:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401536 00000100:00100000:1.0:1788940770.601370:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:1.0:1788940770.601382:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16822:x1875839718401536:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940770.602698:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16822:x1875839718401536:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 1308us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.602711:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:3.0:1788940770.621506:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940770.626172:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401664 00000100:00100000:2.0:1788940770.626197:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401664 00000100:00100000:2.0:1788940770.626308:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:2.0:1788940770.626321:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+8:16804:x1875839718401664:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940770.626345:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940770.626391:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f18477ac00/0x27a633fcdd4c61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d2a expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.626446:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f18477ac00/0x27a633fcdd4c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d2a expref: 9 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.626461:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f18477ac00/0x27a633fcdd4c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d2a expref: 9 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.626471:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477ac00, rc 0) 00000100:00100000:2.0:1788940770.626593:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+9:16804:x1875839718401664:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 274us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940770.626601:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:2.0:1788940770.632659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.632862:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401792 00000100:00100000:1.0:1788940770.632877:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401792 00000100:00100000:1.0:1788940770.632975:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:1.0:1788940770.632989:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+9:16804:x1875839718401792:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788940770.633031:0:18989:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788940770.633069:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788940770.633074:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788940770.633078:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788940770.633081:0:18989:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1788940770.636480:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+9:16804:x1875839718401792:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 3478us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.636498:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788940770.647345:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.647460:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718401920 00000100:00100000:0.0:1788940770.647474:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718401920 00000100:00100000:0.0:1788940770.647574:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788940770.647587:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+9:16804:x1875839718401920:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940770.647610:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940770.647634:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d31 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.647671:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 10 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.647684:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 10 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940770.647695:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eae00, rc 0) 00000100:00100000:0.0:1788940770.647781:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16804:x1875839718401920:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 196us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.647789:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:2.0:1788940770.650299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.650421:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402048 00000100:00100000:1.0:1788940770.650433:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402048 00000100:00100000:1.0:1788940770.650504:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:1.0:1788940770.650561:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16804:x1875839718402048:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940770.651331:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16804:x1875839718402048:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 812us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.651343:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:3.0:1788940770.655202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940770.656373:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402176 00000100:00100000:2.0:1788940770.656393:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402176 00000100:00100000:2.0:1788940770.656487:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:2.0:1788940770.656500:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16804:x1875839718402176:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788940770.657084:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16804:x1875839718402176:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 585us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940770.657093:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788940770.669222:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.670110:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402304 00000100:00100000:0.0:1788940770.670129:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402304 00000100:00100000:0.0:1788940770.670442:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788940770.670458:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16827:x1875839718402304:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940770.671176:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16827:x1875839718402304:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 718us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.671196:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788940770.683141:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.683386:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402432 00000100:00100000:1.0:1788940770.683405:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402432 00000100:00100000:1.0:1788940770.683491:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:1.0:1788940770.683504:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16827:x1875839718402432:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940770.684119:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16827:x1875839718402432:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 614us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.684128:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788940770.691936:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940770.692243:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402560 00000100:00100000:2.0:1788940770.692258:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402560 00000100:00100000:2.0:1788940770.692389:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:2.0:1788940770.692402:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1875839718402560:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788940770.692444:0:18998:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 004757e8-569f-44da-9c79-72fc5ef7a72e@192.168.202.14@tcp t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:2.0:1788940770.692592:0:18998:0:(genops.c:1393:class_connect()) connect: client 004757e8-569f-44da-9c79-72fc5ef7a72e, cookie 0x27a633fcdd4c62a 00000004:00100000:2.0:1788940770.692636:0:18998:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788940770.692644:0:18998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788940770.733610:0:18998:0:(import.c:65:import_set_state_nolock()) ffff89f191e30800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940770.733715:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2349:x1875839718402560:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 41311us (41796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.733729:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940770.736470:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940770.736516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.736687:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402688 00000100:00100000:0.0:1788940770.736699:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402688 00000100:00080000:2.0:1788940770.736919:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940770.736980:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402816 00000100:00100000:1.0:1788940770.736985:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402816 00000100:00100000:1.0:1788940770.737050:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940770.737062:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+7:0:x1875839718402688:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940770.737118:0:18996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788940770.737252:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+7:0:x1875839718402688:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 191us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.737261:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788940770.737288:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788940770.737358:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718402816:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940770.737370:0:18996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788940770.737390:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718402816:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 96us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940770.737396:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:3.0:1788940770.742494:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.745460:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718402944 00000100:00100000:0.0:1788940770.745494:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718402944 00000100:00100000:0.0:1788940770.745612:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940770.745624:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718402944:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940770.745962:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718402944:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 338us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.745972:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788940770.749848:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940770.749916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940770.749964:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403328 00000100:00100000:0.0:1788940770.749979:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403328 00000100:00100000:3.0:1788940770.750080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940770.751811:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403072 00000100:00100000:1.0:1788940770.751836:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403072 00000100:00100000:3.0:1788940770.751924:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403200 00000100:00100000:3.0:1788940770.751939:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403200 00000100:00100000:3.0:1788940770.751974:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940770.751985:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875839718403072:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940770.752027:0:20097:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 004757e8-569f-44da-9c79-72fc5ef7a72e@192.168.202.14@tcp t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:3.0:1788940770.752078:0:20097:0:(genops.c:1393:class_connect()) connect: client 004757e8-569f-44da-9c79-72fc5ef7a72e, cookie 0x27a633fcdd4c631 00002000:00100000:3.0:1788940770.752094:0:20097:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 004757e8-569f-44da-9c79-72fc5ef7a72e/ffff89f0823bd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940770.752109:0:20097:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940770.752743:0:20097:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940770.752787:0:20097:0:(import.c:65:import_set_state_nolock()) ffff89f0823bf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940770.752888:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2349:x1875839718403072:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 903us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940770.752898:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940770.752922:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788940770.752929:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1875839718403200:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940770.752949:0:20097:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 004757e8-569f-44da-9c79-72fc5ef7a72e@192.168.202.14@tcp t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:3.0:1788940770.752971:0:20097:0:(genops.c:1393:class_connect()) connect: client 004757e8-569f-44da-9c79-72fc5ef7a72e, cookie 0x27a633fcdd4c638 00002000:00100000:3.0:1788940770.752978:0:20097:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 004757e8-569f-44da-9c79-72fc5ef7a72e/ffff89f0823ba000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940770.752998:0:20097:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940770.753257:0:20097:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940770.753273:0:20097:0:(import.c:65:import_set_state_nolock()) ffff89f0823bd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940770.753422:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788940770.753438:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718403328:12345-192.168.202.14@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788940770.753920:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2349:x1875839718403200:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 988us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940770.753946:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000004:00080000:3.0:1788940770.757627:0:18999:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4086us 00000004:00200000:0.0:1788940770.773350:0:18999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788940770.773750:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16804:x1875839718403328:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 20308us (23919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940770.773764:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:3.0:1788940770.861007:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940770.950915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940770.951098:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403456 00000100:00100000:2.0:1788940770.951113:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403456 00000100:00100000:2.0:1788940770.951182:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940770.951191:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16848:x1875839718403456:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788940770.951268:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940770.952671:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b600/0x27a633fcdd4c63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d5b expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.952907:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.952923:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.952942:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940770.952985:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940770.952988:0:18998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940770.953026:0:18998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.953056:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b600/0x27a633fcdd4c63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d5b expref: 8 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.953076:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d5b expref: 7 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940770.953098:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940770.953101:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940770.953105:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b400, rc 0) 00000100:00100000:2.0:1788940770.953181:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+7:16848:x1875839718403456:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 1989us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940770.953190:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:2.0:1788940771.884976:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940772.908835:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940773.114246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.114334:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403584 00000100:00100000:0.0:1788940773.114347:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403584 00000100:00080000:2.0:1788940773.114403:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940773.114437:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788940773.114448:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:16901:x1875839718403584:12345-192.168.202.14@tcp:41:lfs.0 00000004:00000024:0.0:1788940773.114514:0:18997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788940773.114644:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:16901:x1875839718403584:12345-192.168.202.14@tcp:41:lfs.0 Request processed in 197us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.114667:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788940773.118574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.118676:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403712 00000100:00100000:0.0:1788940773.118691:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403712 00000100:00100000:0.0:1788940773.118854:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940773.118869:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16901:x1875839718403712:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:0.0:1788940773.118925:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940773.119157:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16901:x1875839718403712:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 292us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.119166:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00080000:3.0:1788940773.119238:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940773.124256:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.124422:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403840 00000100:00100000:1.0:1788940773.124455:0:19687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403840 00000100:00100000:1.0:1788940773.125764:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940773.125782:0:19687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16901:x1875839718403840:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:1.0:1788940773.125852:0:19687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940773.125979:0:19687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:004757e8-569f-44da-9c79-72fc5ef7a72e+6:16901:x1875839718403840:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 203us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.125987:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00080000:3.0:1788940773.126323:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940773.329434:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.329938:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718403968 00000100:00100000:0.0:1788940773.329953:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718403968 00000100:00100000:0.0:1788940773.330083:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:0.0:1788940773.330096:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+10:16933:x1875839718403968:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940773.330124:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940773.330149:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4c64d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d62 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.330186:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4c64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d62 expref: 11 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.330199:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eb000/0x27a633fcdd4c64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d62 expref: 11 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.330209:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb000, rc 0) 00000100:00100000:0.0:1788940773.330296:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718403968:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 203us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.330326:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:2.0:1788940773.343918:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.344988:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404096 00000100:00100000:0.0:1788940773.345008:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404096 00000100:00100000:0.0:1788940773.345094:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:0.0:1788940773.345105:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718404096:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940773.352014:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718404096:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 455us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.352039:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:2.0:1788940773.356920:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738327168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.357008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940773.357076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788940773.357080:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738327040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.357098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940773.357107:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738327552:0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.357125:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940773.357152:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327552 00000100:00100000:2.0:1788940773.357160:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327552 00000100:00100000:2.0:1788940773.357214:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940773.357221:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738327552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.357278:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875839738327552:12345-0@lo:400:kworker.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.357283:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940773.357323:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875839738327552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357643:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940773.357672:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738327424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357692:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940773.357705:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940773.357708:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738327296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357720:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940773.357743:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327168 00000100:00100000:3.0:1788940773.357745:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327168 00000100:00100000:3.0:1788940773.357775:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327040 00000100:00100000:3.0:1788940773.357779:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327040 00000100:00100000:3.0:1788940773.357811:0:19684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940773.357818:0:19684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738327168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357859:0:19684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738327168:12345-0@lo:400:kworker.0 Request processed in 41us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.357865:0:19684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940773.357881:0:19684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940773.357894:0:19684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738327040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357916:0:19684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738327040:12345-0@lo:400:kworker.0 Request processed in 23us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.357920:0:19684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788940773.357937:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940773.357942:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940773.357945:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940773.357966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738327168:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.357999:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327424 00000100:00100000:3.0:1788940773.358001:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327424 00000100:00100000:3.0:1788940773.358024:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327296 00000100:00100000:3.0:1788940773.358027:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327296 00000100:00100000:3.0:1788940773.358040:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940773.358046:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738327424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.358083:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875839738327424:12345-0@lo:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.358088:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940773.358098:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940773.358104:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738327296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.358128:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875839738327296:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.358134:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788940773.358147:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940773.358164:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875839738327296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940773.358174:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875839738327424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.358358:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738326912 00000100:00100000:2.0:1788940773.358362:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738326912 00000100:00100000:2.0:1788940773.358390:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940773.358395:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3308:x1875839738326912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940773.358424:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3308:x1875839738326912:12345-0@lo:400:kworker.0 Request processed in 30us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.358429:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940773.358454:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7833fd5-ba21-4794-9436-ab89d07c3023:3308:1875839738326912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940773.359548:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940773.359579:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738327680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940773.359642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940773.359808:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327680 00000100:00100000:3.0:1788940773.359817:0:19687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327680 00000100:00100000:3.0:1788940773.359872:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940773.359882:0:19687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738327680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940773.359934:0:19687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940773.359993:0:19687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738327680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.360000:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940773.360095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738327680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940773.364353:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.364870:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404224 00000100:00100000:1.0:1788940773.364885:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404224 00000100:00100000:1.0:1788940773.364963:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:1.0:1788940773.364984:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718404224:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940773.366503:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718404224:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 1511us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.366542:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:2.0:1788940773.402160:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940773.402726:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404352 00000100:00100000:3.0:1788940773.402740:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404352 00000100:00100000:3.0:1788940773.402829:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:3.0:1788940773.402843:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f190677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16940:x1875839718404352:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940773.403202:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f190677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16940:x1875839718404352:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 362us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.403211:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:2.0:1788940773.438707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.440599:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404480 00000100:00100000:1.0:1788940773.440620:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404480 00000100:00100000:1.0:1788940773.440708:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:1.0:1788940773.440720:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16940:x1875839718404480:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940773.456886:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16940:x1875839718404480:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 16151us (18177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.456907:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:2.0:1788940773.492605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.492779:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404608 00000100:00100000:0.0:1788940773.492806:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404608 00000100:00100000:0.0:1788940773.492876:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:0.0:1788940773.492888:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16933:x1875839718404608:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940773.492910:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940773.492932:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d8c expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.492982:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d8c expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.492995:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812ebe00/0x27a633fcdd4c654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d8c expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.493005:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812ebe00, rc 0) 00000100:00100000:0.0:1788940773.493095:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16933:x1875839718404608:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 208us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.493102:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:2.0:1788940773.506949:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.507131:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404736 00000100:00100000:0.0:1788940773.507146:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404736 00000100:00100000:0.0:1788940773.507224:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788940773.507236:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16933:x1875839718404736:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788940773.507285:0:18989:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788940773.507317:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788940773.507322:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788940773.507325:0:18989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788940773.507328:0:18989:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788940773.518664:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16933:x1875839718404736:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 11412us (11714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.518683:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788940773.524717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.524891:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404864 00000100:00100000:0.0:1788940773.524903:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404864 00000100:00100000:2.0:1788940773.525045:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:2.0:1788940773.525057:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16933:x1875839718404864:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940773.525079:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940773.525100:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5d93 expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.525133:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.525143:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.525151:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477ae00, rc 0) 00000100:00100000:2.0:1788940773.525216:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16933:x1875839718404864:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 162us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.525239:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:2.0:1788940773.528194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.528406:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718404992 00000100:00100000:0.0:1788940773.528420:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718404992 00000100:00100000:0.0:1788940773.529183:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:0.0:1788940773.529199:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16933:x1875839718404992:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940773.529623:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16933:x1875839718404992:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 427us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.529634:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:1.0:1788940773.536350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940773.536551:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405120 00000100:00100000:2.0:1788940773.536570:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405120 00000100:00100000:2.0:1788940773.536625:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:2.0:1788940773.536633:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16933:x1875839718405120:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788940773.536951:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16933:x1875839718405120:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 318us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.536964:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788940773.542070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.543164:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405248 00000100:00100000:0.0:1788940773.543182:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405248 00000100:00100000:2.0:1788940773.543417:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788940773.543432:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16942:x1875839718405248:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940773.544108:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16942:x1875839718405248:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 677us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.544119:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788940773.564733:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.569682:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405376 00000100:00100000:0.0:1788940773.569728:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405376 00000100:00100000:1.0:1788940773.569908:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788940773.569921:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16942:x1875839718405376:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940773.570249:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16942:x1875839718405376:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 329us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.570360:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788940773.581098:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.581155:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.581193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.581229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.581236:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405888 00000100:00100000:0.0:1788940773.581251:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405888 00000100:00100000:1.0:1788940773.581271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.581298:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405504 00000100:00100000:1.0:1788940773.581303:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405504 00000100:00100000:1.0:1788940773.581334:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406016 00000100:00100000:1.0:1788940773.581339:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406016 00000100:00100000:0.0:1788940773.581340:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:0.0:1788940773.581356:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2352:x1875839718405888:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940773.581368:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940773.581377:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718406016:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940773.581467:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406144 00000100:00100000:2.0:1788940773.581472:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406144 00000100:00100000:2.0:1788940773.581510:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406272 00000100:00100000:2.0:1788940773.581513:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406272 00000100:00100000:2.0:1788940773.581567:0:19684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940773.581574:0:19684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2352:x1875839718406144:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940773.581656:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718406016:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 280us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.581665:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940773.581686:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788940773.581691:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1875839718405504:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788940773.581719:0:18997:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa@192.168.202.14@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788940773.581763:0:18997:0:(genops.c:1393:class_connect()) connect: client dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa, cookie 0x27a633fcdd4c662 00000004:00100000:1.0:1788940773.581812:0:18997:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788940773.582011:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2352:x1875839718405888:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 658us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.582020:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:0.0:1788940773.582274:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940773.582285:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2352:x1875839718406272:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940773.582321:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2352:x1875839718406272:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 39us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.582328:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940773.583686:0:19684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2352:x1875839718406144:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 2097us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.583701:0:19684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00080000:1.0:1788940773.586220:0:18997:0:(import.c:65:import_set_state_nolock()) ffff89f191e34800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940773.586400:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2349:x1875839718405504:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 4700us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.586433:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788940773.592066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.592144:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405632 00000100:00100000:1.0:1788940773.592160:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405632 00000100:00100000:1.0:1788940773.592266:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940773.592279:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:0:x1875839718405632:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940773.592327:0:18996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788940773.592349:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940773.592394:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788940773.592408:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788940773.592581:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718405760 00000100:00100000:2.0:1788940773.592586:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718405760 00000100:00100000:2.0:1788940773.592771:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940773.592780:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:16933:x1875839718405760:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940773.592794:0:20877:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940773.593096:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:16933:x1875839718405760:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 313us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.593097:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:0:x1875839718405632:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 818us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.593114:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788940773.593123:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00080000:3.0:1788940773.593344:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940773.596247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.596333:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406400 00000100:00100000:0.0:1788940773.596346:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406400 00000100:00100000:0.0:1788940773.596407:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940773.596415:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:16933:x1875839718406400:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940773.596554:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:16933:x1875839718406400:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 138us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.596562:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788940773.601014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.601102:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940773.601186:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940773.601285:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406528 00000100:00100000:0.0:1788940773.601299:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406528 00000100:00100000:1.0:1788940773.601406:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406656 00000100:00100000:1.0:1788940773.601410:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406656 00000100:00100000:1.0:1788940773.601436:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940773.601445:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718406528:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788940773.601500:0:19683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa@192.168.202.14@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788940773.601559:0:19683:0:(genops.c:1393:class_connect()) connect: client dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa, cookie 0x27a633fcdd4c669 00002000:00100000:1.0:1788940773.601574:0:19683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa/ffff89f191e35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940773.601588:0:19683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788940773.601719:0:19683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788940773.601760:0:19683:0:(import.c:65:import_set_state_nolock()) ffff89f191e30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940773.601853:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2349:x1875839718406528:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 407us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.601883:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940773.601906:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788940773.601911:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1875839718406656:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788940773.601928:0:19683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa@192.168.202.14@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788940773.601952:0:19683:0:(genops.c:1393:class_connect()) connect: client dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa, cookie 0x27a633fcdd4c670 00002000:00100000:1.0:1788940773.601958:0:19683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa/ffff89f1bf726000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940773.601965:0:19683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788940773.602007:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406784 00000100:00100000:2.0:1788940773.602015:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406784 00002000:00080000:1.0:1788940773.602027:0:19683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940773.602048:0:19683:0:(import.c:65:import_set_state_nolock()) ffff89f1bf722000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940773.602060:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:2.0:1788940773.602071:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:16933:x1875839718406784:12345-192.168.202.14@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788940773.602077:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2349:x1875839718406656:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 162us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.602085:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000004:00200000:2.0:1788940773.602160:0:19000:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788940773.602307:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:16933:x1875839718406784:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 238us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.602315:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940773.739086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940773.739648:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718406912 00000100:00100000:2.0:1788940773.739661:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718406912 00000100:00100000:2.0:1788940773.739733:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788940773.739745:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:16963:x1875839718406912:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788940773.739776:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940773.739815:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dbd expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740001:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740020:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740038:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940773.740091:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940773.740158:0:20877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940773.740188:0:20877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740221:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 8 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740245:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 7 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.740320:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940773.740323:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940773.740328:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a600, rc 0) 00000100:00100000:2.0:1788940773.740409:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:16963:x1875839718406912:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 666us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.740419:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00010000:00010000:2.0:1788940773.935489:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940773.975707:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa 00000001:00100000:3.0:1788940773.975729:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 004757e8-569f-44da-9c79-72fc5ef7a72e 00000100:00100000:3.0:1788940774.382239:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738327808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940774.382342:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940774.382813:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327808 00000100:00100000:1.0:1788940774.382826:0:19687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327808 00000100:00100000:1.0:1788940774.382901:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940774.382913:0:19687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738327808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940774.382943:0:19687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940774.386572:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738327808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940774.391742:0:19687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738327808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8814us (9383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.391763:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788940774.956719:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940775.499456:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa 00000001:00100000:0.0:1788940775.499470:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 004757e8-569f-44da-9c79-72fc5ef7a72e 00000001:00100000:2.0:1788940775.950943:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa 00000001:00100000:2.0:1788940775.950959:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 004757e8-569f-44da-9c79-72fc5ef7a72e 00010000:00010000:2.0:1788940775.982638:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940776.302095:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940777.007742:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940777.127253:0:20966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788940778.029695:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940778.476866:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940778.476903:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738327936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940778.477015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940778.477178:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738327936 00000100:00100000:3.0:1788940778.477195:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738327936 00000100:00100000:3.0:1788940778.477281:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940778.477294:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738327936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940778.477341:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940778.477401:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738327936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940778.477410:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940778.477447:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738327936:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788940778.477507:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940778.477712:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738328192:0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.477729:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738328064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.477776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940778.477787:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738328320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.477800:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738328576:0@lo:400:kworker.0 00000100:00100000:0.0:1788940778.477820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940778.477847:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328320 00000100:00100000:0.0:1788940778.477850:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940778.477852:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328320 00000100:00100000:0.0:1788940778.477856:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738328448:0@lo:400:kworker.0 00000100:00100000:0.0:1788940778.477877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940778.477885:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328448 00000100:00100000:1.0:1788940778.477888:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328448 00000100:00100000:0.0:1788940778.477906:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940778.477922:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738328320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940778.477963:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875839738328320:12345-0@lo:400:kworker.0 Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940778.477986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940778.478025:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328064 00000100:00100000:2.0:1788940778.478030:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328064 00000100:00100000:2.0:1788940778.478060:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940778.478066:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3305:x1875839738328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940778.478101:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3305:x1875839738328064:12345-0@lo:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940778.478106:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788940778.478212:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940778.478614:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940778.478657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738328064:0@lo:400:kworker.0 00000100:00100000:2.0:1788940778.478686:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328576 00000100:00100000:2.0:1788940778.478691:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328576 00000100:00100000:0.0:1788940778.484845:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940778.484873:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940778.484893:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738328448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940778.484949:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875839738328320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.485023:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875839738328448:12345-0@lo:400:kworker.0 Request processed in 139us (7144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940778.485031:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940778.485031:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875839738328448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.485055:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328192 00000100:00100000:1.0:1788940778.485064:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328192 00000100:00100000:2.0:1788940778.485116:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940778.485138:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940778.485145:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738328192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940778.485188:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738328192:12345-0@lo:400:kworker.0 Request processed in 44us (7435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940778.485195:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940778.485199:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738328576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940778.485254:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875839738328576:12345-0@lo:400:kworker.0 Request processed in 130us (6640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940778.485261:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940778.485595:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738328192:0@lo:400:kworker.0 00000100:00100000:0.0:1788940778.485628:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875839738328576:0@lo:400:kworker.0 00000100:00080000:2.0:1788940778.485677:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940778.485694:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940779.006091:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940779.006184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940779.006226:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407168 00000100:00100000:1.0:1788940779.006237:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407168 00000100:00100000:1.0:1788940779.006317:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:1.0:1788940779.006336:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2351:x1875839718407168:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788940779.007424:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2351:x1875839718407168:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 1085us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940779.007435:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940779.012045:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407040 00000100:00100000:2.0:1788940779.012061:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407040 00000100:00100000:2.0:1788940779.012127:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:2.0:1788940779.012137:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2351:x1875839718407040:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012234:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2351:x1875839718407040:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 99us (6153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012241:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00080000:2.0:1788940779.012276:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940779.012380:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940779.012459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940779.012485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940779.012536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940779.012563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940779.012583:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407296 00000100:00100000:2.0:1788940779.012586:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407296 00000100:00100000:2.0:1788940779.012615:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407424 00000100:00100000:2.0:1788940779.012617:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407424 00000100:00100000:2.0:1788940779.012631:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407680 00000100:00100000:2.0:1788940779.012633:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407680 00000100:00100000:2.0:1788940779.012643:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407808 00000100:00100000:2.0:1788940779.012645:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407808 00000100:00100000:2.0:1788940779.012660:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940779.012665:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2350:x1875839718407296:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012703:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2350:x1875839718407296:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012710:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940779.012723:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940779.012738:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2350:x1875839718407424:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012790:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2350:x1875839718407424:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012795:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788940779.012808:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940779.012813:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2351:x1875839718407680:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012836:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2351:x1875839718407680:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012842:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788940779.012853:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940779.012859:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2351:x1875839718407808:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012881:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2351:x1875839718407808:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012888:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940779.012909:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407552 00000100:00100000:2.0:1788940779.012912:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407552 00000100:00100000:2.0:1788940779.012943:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940779.012950:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2350:x1875839718407552:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.012988:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2350:x1875839718407552:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 38us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.012995:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00080000:2.0:1788940779.013017:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940779.013021:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940779.013023:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940779.062547:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940779.507170:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940779.507190:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738328704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940779.507260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940779.507319:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738328704 00000100:00100000:2.0:1788940779.507327:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738328704 00000100:00100000:2.0:1788940779.507368:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940779.507377:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738328704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940779.507411:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940779.507455:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738328704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.507463:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940779.507508:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738328704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940780.077449:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788940780.322824:0:21114:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4dd90310 20000000:00000080:0.0:1788940780.322848:0:21114:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89f08378c000 uarg=0000000000000000 20000000:01000000:0.0:1788940780.322897:0:21114:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940780.322904:0:21114:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940780.322911:0:21114:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788940780.323961:0:21115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788940780.324154:0:21114:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788940780.332338:0:21114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788940780.332371:0:21114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332391:0:21114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 18 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332410:0:21114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 18 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332418:0:21114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332428:0:21114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332435:0:21114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332442:0:21114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332494:0:21114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 12 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332513:0:21114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 12 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.332559:0:21114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738328832:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940780.332681:0:21114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332690:0:21114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.332699:0:21114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738328960:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940780.332748:0:21114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332756:0:21114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 18 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.332764:0:21114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329088:0@lo:104: 00000100:00100000:0.0:1788940780.332800:0:21114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940780.332835:0:21114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 18 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332842:0:21114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 18 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.332850:0:21114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329216:0@lo:104: 00000100:00100000:0.0:1788940780.332869:0:21114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940780.332890:0:21114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 18 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.332898:0:21114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 18 pid: 18989 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.332905:0:21114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329344:0@lo:104: 00000100:00100000:0.0:1788940780.332928:0:21114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940780.332939:0:21114:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f190209600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940780.333819:0:18980:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940780.333839:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329088 00000100:00100000:3.0:1788940780.333847:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329088 00000100:00100000:3.0:1788940780.333892:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329216 00000100:00100000:3.0:1788940780.333895:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329216 00000100:00100000:3.0:1788940780.333905:0:18980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329344 00000100:00100000:3.0:1788940780.333908:0:18980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329344 00000100:00100000:3.0:1788940780.333937:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940780.333946:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+5:21114:x1875839738329088:12345-0@lo:104: 00010000:00010000:3.0:1788940780.333965:0:18980:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334038:0:18980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940780.334044:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+5:21114:x1875839738329088:12345-0@lo:104: Request processed in 100us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.334052:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940780.334071:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940780.334310:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+4:21114:x1875839738329216:12345-0@lo:104: 00010000:00010000:3.0:1788940780.334320:0:18980:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334367:0:18980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940780.334373:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+4:21114:x1875839738329216:12345-0@lo:104: Request processed in 297us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.334379:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940780.334393:0:18980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940780.334400:0:18980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bb9c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:21114:x1875839738329344:12345-0@lo:104: 00010000:00010000:3.0:1788940780.334408:0:18980:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334434:0:18980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940780.334438:0:18980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bb9c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7833fd5-ba21-4794-9436-ab89d07c3023+3:21114:x1875839738329344:12345-0@lo:104: Request processed in 40us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.334443:0:18980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788940780.334481:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940780.334486:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334494:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3600 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940780.334497:0:18984:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334506:0:18984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940780.334512:0:18984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940780.334539:0:18984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940780.334577:0:18984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334583:0:18984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940780.334605:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334611:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f082ad3600/0x27a633fcdd4c4e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c4e8 expref: -99 pid: 20402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334625:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940780.334628:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334633:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97000 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940780.334636:0:18984:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334643:0:18984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940780.334649:0:18984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940780.334653:0:18984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940780.334663:0:18984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334668:0:18984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940780.334673:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334689:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f1bfa97000/0x27a633fcdd4c38a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c391 expref: -99 pid: 19681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334697:0:18984:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940780.334699:0:18984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334705:0:18984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f181521a00 already unused, calling callback (ffffffffc1d10c20) 10000000:00010000:3.0:1788940780.334708:0:18984:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334714:0:18984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940780.334720:0:18984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940780.334725:0:18984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940780.334749:0:18984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334755:0:18984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940780.334771:0:18984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334777:0:18984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff89f181521a00/0x27a633fcdd4c33d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27a633fcdd4c344 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.334791:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940780.334798:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940780.334800:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940780.334807:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940780.334820:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738329472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940780.334852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940780.334886:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940780.334892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738329600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940780.334912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940780.334939:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738329728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940780.334965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940780.335002:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329472 00000100:00100000:3.0:1788940780.335007:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329472 00010000:00010000:3.0:1788940780.335028:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 19 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.335043:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329600 00000100:00100000:3.0:1788940780.335046:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329600 00010000:00010000:3.0:1788940780.335056:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 20 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.335065:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329728 00000100:00100000:3.0:1788940780.335067:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329728 00000100:00100000:1.0:1788940780.335615:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940780.335635:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+21:3307:x1875839738329472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940780.335658:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940780.335669:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 21 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.335685:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 21 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.335710:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940780.335790:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+21:3307:x1875839738329472:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.335800:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940780.335832:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940780.335842:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+20:3307:x1875839738329600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940780.335852:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940780.335858:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 20 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.335868:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 20 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.335879:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940780.335901:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7833fd5-ba21-4794-9436-ab89d07c3023+20:3307:x1875839738329600:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.335922:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788940780.336047:0:21114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f1bfa97800/0x27a633fcdd4c4e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c4e1 expref: 19 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.336064:0:21114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329088:0@lo:104: 00010000:00010000:2.0:1788940780.336093:0:21114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f19258de00/0x27a633fcdd4c391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c38a expref: 18 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.336102:0:21114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329216:0@lo:104: 00000100:00100000:2.0:1788940780.336114:0:21114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738329344:0@lo:104: 00010000:00010000:3.0:1788940780.337377:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 21 pid: 18989 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.337441:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940780.337458:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae72a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:3305:x1875839738329728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940780.337480:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.337490:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 17 pid: 18989 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.337515:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 17 pid: 18989 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.337570:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f181521e00/0x27a633fcdd4c344 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27a633fcdd4c33d expref: 17 pid: 18989 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.337584:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940780.337660:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae72a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:3305:x1875839738329728:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.337669:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940780.337715:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7833fd5-ba21-4794-9436-ab89d07c3023:3305:1875839738329728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940780.338070:0:21114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae852d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738328832:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940780.338107:0:21114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae853100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21114:1875839738328960:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940780.338142:0:21114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.338890:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738329600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940780.338977:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738329472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940780.344701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940780.344838:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718407936 00000100:00100000:0.0:1788940780.344855:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718407936 00010000:00010000:0.0:1788940780.344905:0:18982:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.344966:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788940780.344978:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2352:x1875839718407936:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940780.344993:0:18982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940780.344999:0:18982:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.345012:0:18982:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.345031:0:18982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c65b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d93 expref: 13 pid: 18990 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.345045:0:18982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940780.345306:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:2352:x1875839718407936:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 329us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.345418:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940780.359578:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940780.359745:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408064 00000100:00100000:3.0:1788940780.359756:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408064 00010000:00010000:3.0:1788940780.359795:0:18983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.359834:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788940780.359844:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:2352:x1875839718408064:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940780.359859:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.359865:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359877:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359894:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eae00/0x27a633fcdd4c623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d31 expref: 12 pid: 18991 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359911:0:18983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359931:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359952:0:18983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359959:0:18983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359967:0:18983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359973:0:18983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359981:0:18983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940780.359984:0:18983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.359992:0:18983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.360013:0:18983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.360025:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940780.360153:0:21114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.360162:0:21114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.360169:0:21114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89f0812eb600/0x27a633fcdd4c685 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.361244:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:2352:x1875839718408064:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1393us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.361256:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:3.0:1788940781.102088:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788940781.548665:0:18993:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940781.548675:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1914c7000 from 10 10000000:01000000:1.0:1788940781.548682:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940781.548757:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.548771:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.548791:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.548825:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738329856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.548939:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.549009:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940781.550476:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329856 00000100:00100000:2.0:1788940781.550494:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329856 00000100:00100000:2.0:1788940781.550612:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788940781.550626:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+16:18993:x1875839738329856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940781.550657:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940781.550685:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f18477ba00/0x27a633fcdd4c693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c68c expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.550719:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f18477ba00/0x27a633fcdd4c693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c68c expref: 17 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.550743:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f18477ba00/0x27a633fcdd4c693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c68c expref: 17 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.550757:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477ba00, rc 0) 00000100:00100000:2.0:1788940781.550844:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738329856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940781.550853:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940781.551061:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738329856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940781.551792:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c693 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.551806:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c693 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.551916:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738329984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.551988:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.552039:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.554169:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738329984 00000100:00100000:3.0:1788940781.554188:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738329984 00000100:00100000:3.0:1788940781.554274:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940781.554286:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738329984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940781.554754:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738329984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.554763:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940781.555590:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738329984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.555678:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.555760:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.555822:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940781.557831:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330112 00000100:00100000:2.0:1788940781.557873:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330112 00000100:00100000:2.0:1788940781.557962:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788940781.557975:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738330112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940781.559245:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738330112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1265us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940781.559257:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788940781.559287:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940781.567888:0:21129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788940781.570287:0:18993:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788940781.570335:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940781.570358:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c693 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.570375:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2a00/0x27a633fcdd4c68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c693 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940781.570391:0:18993:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940781.570394:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f190704000 from 10 10000000:01000000:2.0:1788940781.570397:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940781.570471:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.570479:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.570491:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.570569:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940781.570664:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940781.570715:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf805c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.572163:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330240 00000100:00100000:3.0:1788940781.572187:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330240 00000100:00100000:3.0:1788940781.572860:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940781.572875:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+17:18993:x1875839738330240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940781.572897:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940781.572919:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97000/0x27a633fcdd4c6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c69a expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.572953:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97000/0x27a633fcdd4c6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c69a expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.572965:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97000/0x27a633fcdd4c6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c69a expref: 18 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.572975:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97000, rc 0) 00000100:00100000:3.0:1788940781.573092:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.573099:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788940781.575187:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940781.575237:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6a1 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.575249:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c6a1 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.575355:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940781.575423:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940781.576219:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf805c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.578569:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330368 00000100:00100000:0.0:1788940781.578590:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330368 00000100:00100000:0.0:1788940781.578673:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940781.578686:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940781.579615:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 928us (4187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.579627:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788940781.580048:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940781.580190:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940781.580259:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940781.585331:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf805c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.588259:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330496 00000100:00100000:3.0:1788940781.588281:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330496 00000100:00100000:3.0:1788940781.588380:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940781.588395:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940781.591319:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2917us (11050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.591334:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788940781.600117:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ba975f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940781.601293:0:21130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940781.601501:0:18993:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940781.601612:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940781.601627:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6a1 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.601650:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f18477b600/0x27a633fcdd4c69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6a1 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940781.601663:0:18993:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940781.601666:0:18993:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89f1bee49000 from 10 10000000:01000000:1.0:1788940781.601669:0:18993:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940781.601718:0:18993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.601737:0:18993:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.601748:0:18993:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.601777:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.601884:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.601933:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.602077:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330624 00000100:00100000:0.0:1788940781.602087:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330624 00000100:00100000:0.0:1788940781.602156:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940781.602175:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+18:18993:x1875839738330624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940781.602193:0:18989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940781.602208:0:18989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4c6af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27a633fcdd4c6a8 expref: -99 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.602237:0:18989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4c6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27a633fcdd4c6a8 expref: 19 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.602247:0:18989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f0812eb800/0x27a633fcdd4c6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27a633fcdd4c6a8 expref: 19 pid: 18989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.602254:0:18989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f0812eb800, rc 0) 00000100:00100000:0.0:1788940781.602298:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738330624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.602306:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788940781.602332:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940781.602395:0:18993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6af expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.602405:0:18993:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27a633fcdd4c6af expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.602461:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.602486:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.602508:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.602567:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330752 00000100:00100000:3.0:1788940781.602572:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330752 00000100:00100000:3.0:1788940781.602603:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788940781.602610:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738330752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940781.602903:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738330752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.602911:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788940781.602930:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.602959:0:18993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940781.603001:0:18993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.603031:0:18993:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.603250:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738330880 00000100:00100000:0.0:1788940781.603254:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738330880 00000100:00100000:0.0:1788940781.603278:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788940781.603286:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738330880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940781.603460:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:18993:x1875839738330880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.603467:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788940781.603478:0:18993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7833fd5-ba21-4794-9436-ab89d07c3023:18993:1875839738330880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940781.604378:0:21131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940781.604624:0:18993:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940781.604655:0:18993:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940781.604666:0:18993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6af expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.604677:0:18993:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff89f082ad2200/0x27a633fcdd4c6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27a633fcdd4c6af expref: -99 pid: 18993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.693294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940781.697434:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408192 00000100:00100000:3.0:1788940781.697458:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408192 00000100:00100000:3.0:1788940781.697630:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:3.0:1788940781.697643:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+11:16819:x1875839718408192:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940781.697667:0:18991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940781.697689:0:18991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4c6b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dc4 expref: -99 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.697740:0:18991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4c6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dc4 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.697753:0:18991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f1bfa97200/0x27a633fcdd4c6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dc4 expref: 12 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.697763:0:18991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa97200, rc 0) 00000100:00100000:3.0:1788940781.697863:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408192:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 222us (4904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.697892:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:1.0:1788940781.707611:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940781.711687:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408320 00000100:00100000:0.0:1788940781.711711:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408320 00000100:00100000:0.0:1788940781.712296:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:0.0:1788940781.712311:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408320:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940781.712772:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408320:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 464us (5175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.712799:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788940781.720693:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940781.722436:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408448 00000100:00100000:0.0:1788940781.722456:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408448 00000100:00100000:0.0:1788940781.722604:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:0.0:1788940781.722619:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408448:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940781.723350:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408448:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 732us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.723361:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:1.0:1788940781.732450:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940781.732712:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408576 00000100:00100000:2.0:1788940781.732736:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408576 00000100:00100000:2.0:1788940781.732935:0:18990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:2.0:1788940781.732953:0:18990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+12:16819:x1875839718408576:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940781.733044:0:18990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940781.733072:0:18990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c6bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dcb expref: -99 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.733112:0:18990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dcb expref: 13 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.733147:0:18990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89f18477ae00/0x27a633fcdd4c6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dcb expref: 13 pid: 18990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.733159:0:18990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477ae00, rc 0) 00000100:00100000:2.0:1788940781.733239:0:18990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16819:x1875839718408576:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 291us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940781.733246:0:18990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788940781.735566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940781.735660:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408704 00000100:00100000:0.0:1788940781.735674:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408704 00000100:00100000:0.0:1788940781.735750:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:0.0:1788940781.735765:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16819:x1875839718408704:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940781.736510:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16819:x1875839718408704:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 747us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.736564:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:1.0:1788940781.747163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940781.758116:0:18990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408832 00000100:00100000:2.0:1788940781.758141:0:18990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408832 00000100:00100000:3.0:1788940781.758395:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:3.0:1788940781.758412:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16819:x1875839718408832:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940781.758778:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:16819:x1875839718408832:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 371us (11629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.758785:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:1.0:1788940782.091683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.092187:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718408960 00000100:00100000:2.0:1788940782.092201:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718408960 00000100:00100000:2.0:1788940782.092291:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940782.092304:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+6:17428:x1875839718408960:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940782.092330:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.092357:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c6c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dd2 expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092445:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092463:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092480:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092628:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092657:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.092666:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788940782.093635:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940782.095006:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477be00/0x27a633fcdd4c6d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095031:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477be00/0x27a633fcdd4c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095043:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477be00/0x27a633fcdd4c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.095086:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940782.095090:0:18998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940782.095140:0:18998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477be00/0x27a633fcdd4c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095152:0:18998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095159:0:18998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095166:0:18998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095173:0:18998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.095177:0:18998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095198:0:18998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095213:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940782.095216:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.095221:0:18998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095228:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095245:0:18998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095251:0:18998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095257:0:18998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095264:0:18998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.095267:0:18998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095273:0:18998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095280:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.095283:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.095285:0:18998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095300:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095419:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c6c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dd2 expref: 8 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095436:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477be00/0x27a633fcdd4c6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dd2 expref: 7 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.095445:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f194b5bf00) 00010000:00010000:2.0:1788940782.095448:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940782.095450:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477be00, rc 0) 00000100:00100000:2.0:1788940782.096229:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+7:17428:x1875839718408960:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3920us (4566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.096244:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788940782.102249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.102352:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409216 00000100:00100000:2.0:1788940782.102367:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409216 00000100:00100000:2.0:1788940782.102445:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788940782.102458:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:17428:x1875839718409216:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940782.102486:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.102511:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c6e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dd9 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102647:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102665:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102697:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102715:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102733:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.102739:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103151:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477aa00/0x27a633fcdd4c6f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103161:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477aa00/0x27a633fcdd4c6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103168:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477aa00/0x27a633fcdd4c6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.103179:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788940782.103420:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103428:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103436:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103443:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.103454:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103464:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103479:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89f194b5bf00) 00010000:00010000:2.0:1788940782.103482:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.103488:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103496:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c6e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103510:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103570:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103576:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103581:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.103584:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103590:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103598:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.103601:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.103611:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.103617:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c6ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.104233:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c6e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dd9 expref: 10 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.104258:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477aa00/0x27a633fcdd4c6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dd9 expref: 9 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.104267:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f194b5b200) 00010000:00010000:2.0:1788940782.104270:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.104273:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477aa00, rc 0) 00000100:00100000:2.0:1788940782.104366:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17428:x1875839718409216:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1911us (2131us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788940782.104374:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788940782.109049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.109164:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409344 00000100:00100000:0.0:1788940782.109178:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409344 00000100:00100000:0.0:1788940782.109248:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940782.109259:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17428:x1875839718409344:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788940782.109391:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17428:x1875839718409344:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.109399:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788940782.118331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.118590:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409472 00000100:00100000:2.0:1788940782.118607:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409472 00000100:00100000:2.0:1788940782.118689:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788940782.118701:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17434:x1875839718409472:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.118740:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.118767:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5de0 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118853:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118905:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118920:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118938:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118945:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.118951:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119192:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119201:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119210:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119216:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.119221:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119230:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119243:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940782.119253:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.119259:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119265:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119279:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119286:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119292:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119297:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.119300:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119306:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119313:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.119316:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.119318:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119324:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119361:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c703 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5de0 expref: 10 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119384:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940782.119386:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.119390:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5de0 expref: 10 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.119399:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a800, rc 0) 00000100:00100000:2.0:1788940782.119490:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17434:x1875839718409472:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 790us (1175us total) trans 0 rc 301/301 00000100:00100000:2.0:1788940782.119498:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788940782.125385:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.125589:0:19005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409600 00000100:00100000:2.0:1788940782.125609:0:19005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409600 00000100:00100000:2.0:1788940782.125684:0:19005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940782.125698:0:19005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17434:x1875839718409600:12345-192.168.202.14@tcp:700:lfs.0 00000100:00100000:2.0:1788940782.125828:0:19005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17434:x1875839718409600:12345-192.168.202.14@tcp:700:lfs.0 Request processed in 132us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.125837:0:19005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:3.0:1788940782.134581:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940782.134800:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.135455:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409856 00000100:00100000:0.0:1788940782.135500:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409856 00000100:00100000:0.0:1788940782.135633:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788940782.135646:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17434:x1875839718409856:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:0.0:1788940782.136378:0:18997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940782.136424:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5d5b expref: 9 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.136455:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:0.0:1788940782.136462:0:18997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940782.137305:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.137329:0:18997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 5 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.137340:0:18997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.137393:0:18997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 5 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.138262:0:18997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 5 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940782.138285:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18997:1875839738331008:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788940782.138973:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f198614c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940782.141053:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4cd0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18997:1875839738331008:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788940782.141098:0:18997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.144510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940782.144879:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718409984 00000100:00100000:3.0:1788940782.144895:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718409984 00010000:00010000:3.0:1788940782.145038:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 6 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940782.145094:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788940782.145107:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2352:x1875839718409984:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940782.145127:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940782.145135:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 6 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145151:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 6 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145194:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c67e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dbd expref: 6 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145215:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:3.0:1788940782.145239:0:18981:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145251:0:18981:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145260:0:18981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.145305:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940782.145360:0:18997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.145371:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940782.145374:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2352:x1875839718409984:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 268us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940782.145387:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00010000:00010000:2.0:1788940782.145420:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.145433:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.145454:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788940782.146791:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788940782.147558:0:18997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940782.148265:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148277:0:18997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148286:0:18997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148293:0:18997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eae00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.148299:0:18997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148309:0:18997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148330:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:2.0:1788940782.148333:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.148339:0:18997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.148347:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812eae00/0x27a633fcdd4c718 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940782.148374:0:18997:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faf992d8 reply state 00000000e7c5252d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940782.148404:0:18997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940782.148611:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+10:17434:x1875839718409856:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 12961us (13813us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788940782.148622:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00010000:00010000:2.0:1788940782.154686:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154709:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154727:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154735:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.154740:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154751:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154780:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.154784:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.154790:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.154798:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c71f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.199264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.200018:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718410112 00000100:00100000:2.0:1788940782.200034:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718410112 00000100:00100000:2.0:1788940782.200146:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788940782.200159:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+9:17442:x1875839718410112:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:2.0:1788940782.200194:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.200224:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5de7 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200311:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c72d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200329:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200346:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.200396:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940782.200401:0:20877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940782.200451:0:20877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200483:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5de7 expref: 11 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200505:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b000/0x27a633fcdd4c72d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5de7 expref: 10 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.200514:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.200591:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940782.200597:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b000, rc 0) 00000100:00100000:2.0:1788940782.200689:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+10:17442:x1875839718410112:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 531us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.200705:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788940782.235828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.235973:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718410240 00000100:00100000:2.0:1788940782.235987:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718410240 00000100:00100000:2.0:1788940782.236057:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788940782.236065:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:17443:x1875839718410240:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.236090:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.236112:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dee expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236183:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c73b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236196:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236206:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.236244:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940782.236246:0:18998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940782.236274:0:18998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c73b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236296:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dee expref: 7 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236312:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a200/0x27a633fcdd4c73b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dee expref: 6 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.236339:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.236342:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940782.236345:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a200, rc 0) 00000100:00100000:2.0:1788940782.236411:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:17443:x1875839718410240:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 347us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.236416:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788940782.239432:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.239547:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718410368 00000100:00100000:2.0:1788940782.239559:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718410368 00000100:00100000:2.0:1788940782.239628:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788940782.239648:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:17443:x1875839718410368:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.239678:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.239706:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5df5 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239795:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239811:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239822:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239833:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239840:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239870:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239990:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.239996:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240001:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.240033:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940782.240036:0:20877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940782.240053:0:20877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240063:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240068:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240074:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240078:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.240081:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240086:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240102:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.240104:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.240109:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240113:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240124:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240127:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240130:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240134:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.240136:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240139:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240142:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89f194b5b500) 00010000:00010000:2.0:1788940782.240144:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.240145:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240148:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240184:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5df5 expref: 8 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240194:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5df5 expref: 7 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.240200:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f194b5b300) 00010000:00010000:2.0:1788940782.240201:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940782.240202:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477bc00, rc 0) 00000100:00100000:2.0:1788940782.240274:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:17443:x1875839718410368:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 629us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.240278:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:1.0:1788940782.251246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.252942:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718410624 00000100:00100000:2.0:1788940782.252960:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718410624 00000100:00100000:2.0:1788940782.253024:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:2.0:1788940782.253034:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+7:17443:x1875839718410624:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.253057:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.253079:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5dfc expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.253179:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940782.253310:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c75e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dfc expref: 9 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.253323:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.253325:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940782.253347:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5dfc expref: 9 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.253359:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b800, rc 0) 00000100:00100000:2.0:1788940782.253471:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+8:17443:x1875839718410624:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 438us (2241us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788940782.253477:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788940782.262030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.262120:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718410880 00000100:00100000:2.0:1788940782.262134:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718410880 00000100:00100000:2.0:1788940782.262212:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788940782.262225:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+8:17443:x1875839718410880:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:2.0:1788940782.262307:0:20877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940782.262346:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c757 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5df5 expref: 8 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.262372:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f194b5b300) 00010000:00010000:2.0:1788940782.262384:0:20877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940782.262412:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.262425:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.262433:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940782.262902:0:20877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cedb9901 reply state 000000000d6d56b5 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940782.262913:0:20877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788940782.262939:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788940782.263054:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+9:17443:x1875839718410880:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 830us (1039us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788940782.263062:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788940782.272479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.272772:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718411136 00000100:00100000:2.0:1788940782.272786:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718411136 00000100:00100000:2.0:1788940782.272878:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788940782.272893:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+9:17443:x1875839718411136:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788940782.273219:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+10:17443:x1875839718411136:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 328us (757us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788940782.273227:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00010000:00010000:1.0:1788940782.273440:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273454:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273463:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273470:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.273476:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273485:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273508:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f194b5b500) 00010000:00010000:1.0:1788940782.273567:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788940782.273576:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.273584:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c76c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.285245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.285364:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718411392 00000100:00100000:2.0:1788940782.285376:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718411392 00000100:00100000:2.0:1788940782.285437:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788940782.285446:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+9:17443:x1875839718411392:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.285478:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.285514:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e03 expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.285986:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286005:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286019:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286035:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286061:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286068:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.286214:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940782.286345:0:18998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286355:0:18998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286362:0:18998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286369:0:18998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.286374:0:18998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286384:0:18998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286398:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.286402:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.286408:0:18998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286415:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c77a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286443:0:18998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286449:0:18998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286455:0:18998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286461:0:18998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940782.286464:0:18998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286470:0:18998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286478:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89f194b5b300) 00010000:00010000:2.0:1788940782.286481:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940782.286583:0:18998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286823:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286881:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c773 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e03 expref: 11 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286894:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.286897:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940782.286909:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e03 expref: 11 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.286920:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477bc00, rc 0) 00000100:00100000:2.0:1788940782.287072:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+10:17443:x1875839718411392:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1624us (1840us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788940782.287081:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:3.0:1788940782.293074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.293255:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718411520 00000100:00100000:1.0:1788940782.293270:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718411520 00000100:00100000:1.0:1788940782.293342:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:1.0:1788940782.293354:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+10:17443:x1875839718411520:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788940782.293387:0:18996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940782.293417:0:18996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c78f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e0a expref: -99 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.293572:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.293986:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.294004:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940782.294039:0:18996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940782.294042:0:18996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940782.294068:0:18996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.294103:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c78f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 12 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.294143:0:18996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 11 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.294152:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:1.0:1788940782.294156:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940782.294161:0:18996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad3a00, rc 0) 00000100:00100000:1.0:1788940782.294275:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+11:17443:x1875839718411520:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 922us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940782.294283:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:3.0:1788940782.298312:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.298373:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718411648 00000100:00100000:2.0:1788940782.298388:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718411648 00000100:00100000:2.0:1788940782.298460:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788940782.298474:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+11:17443:x1875839718411648:12345-192.168.202.14@tcp:37:lfs.0 00000100:00100000:0.0:1788940782.305001:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+11:17443:x1875839718411648:12345-192.168.202.14@tcp:37:lfs.0 Request processed in 6515us (6689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.305016:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:3.0:1788940782.317983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.318095:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718411904 00000100:00100000:0.0:1788940782.318111:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718411904 00000100:00100000:0.0:1788940782.318200:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788940782.318214:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b9fb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+11:17443:x1875839718411904:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940782.318783:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b9fb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+12:17443:x1875839718411904:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 569us (1128us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788940782.318793:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788940782.363402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.363638:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718412032 00000100:00100000:0.0:1788940782.363653:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718412032 00000100:00100000:1.0:1788940782.363784:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:1.0:1788940782.363799:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+10:17449:x1875839718412032:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940782.363831:0:18997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940782.363860:0:18997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e11 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.363962:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.363982:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.363996:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364013:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364045:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364050:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364160:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2400/0x27a633fcdd4c7b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364166:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2400/0x27a633fcdd4c7b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364171:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2400/0x27a633fcdd4c7b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940782.364199:0:18997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940782.364201:0:18997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940782.364238:0:18997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2400/0x27a633fcdd4c7b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364249:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364254:0:18997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364259:0:18997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364263:0:18997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.364266:0:18997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364278:0:18997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364289:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:1.0:1788940782.364291:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940782.364296:0:18997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364301:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364313:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364316:0:18997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364320:0:18997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364323:0:18997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.364325:0:18997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364328:0:18997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364331:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89f1983af800) 00010000:00010000:1.0:1788940782.364332:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940782.364334:0:18997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364343:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364373:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e11 expref: 12 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364383:0:18997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2400/0x27a633fcdd4c7b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e11 expref: 11 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.364388:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:1.0:1788940782.364390:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788940782.364391:0:18997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2400, rc 0) 00000100:00100000:1.0:1788940782.364460:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+11:17449:x1875839718412032:12345-192.168.202.14@tcp:101:bash.0 Request processed in 665us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940782.364465:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788940782.368623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.368770:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718412288 00000100:00100000:1.0:1788940782.368782:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718412288 00000100:00100000:1.0:1788940782.368842:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788940782.368851:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+11:17449:x1875839718412288:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940782.368882:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940782.368909:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c7b9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e18 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.369052:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.369066:0:20877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 11 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.369091:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.369131:0:20877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 11 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.369146:0:20877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 11 pid: 18996 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.369162:0:20877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331136:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788940782.369272:0:20877:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1868acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940782.372443:0:20877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f66680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331136:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788940782.372476:0:20877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940782.374028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.374611:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718412416 00000100:00100000:0.0:1788940782.374624:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718412416 00010000:00010000:0.0:1788940782.374685:0:18982:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 12 pid: 18996 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940782.374787:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788940782.374800:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+12:2353:x1875839718412416:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940782.374821:0:18982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940782.374829:0:18982:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 12 pid: 18996 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374846:0:18982:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 12 pid: 18996 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374897:0:18982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3a00/0x27a633fcdd4c796 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e0a expref: 12 pid: 18996 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374915:0:18982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:0.0:1788940782.374921:0:18982:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374932:0:18982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374941:0:18982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.374974:0:18982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940782.375005:0:20877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.375014:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940782.375067:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+11:2353:x1875839718412416:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 267us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.375076:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00010000:00010000:1.0:1788940782.375161:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.375187:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.375203:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376281:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376291:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376297:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940782.376306:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940782.376324:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376329:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376334:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376337:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2c00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.376340:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376345:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376354:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:1.0:1788940782.376356:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940782.376359:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376372:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7c0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940782.376383:0:20877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf39e3e1 reply state 0000000083166652 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.376389:0:20877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788940782.376464:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c7b9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 14 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376476:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 13 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.376481:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940782.376482:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788940782.376484:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:1.0:1788940782.376588:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ba975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17449:x1875839718412288:12345-192.168.202.14@tcp:101:bash.0 Request processed in 7738us (7977us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788940782.376594:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00010000:00010000:1.0:1788940782.381179:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381200:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381208:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381217:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.381241:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381251:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381269:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89f1983af800) 00010000:00010000:1.0:1788940782.381273:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940782.381277:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.381283:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c7c7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940782.388246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.388327:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718412544 00000100:00100000:1.0:1788940782.388344:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718412544 00000100:00100000:1.0:1788940782.388439:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:1.0:1788940782.388450:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+13:17449:x1875839718412544:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788940782.388477:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940782.388498:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c7dc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e1f expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388623:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388639:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388652:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940782.388714:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940782.388734:0:18998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940782.388755:0:18998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388767:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388793:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c7dc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 15 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388812:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 14 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.388822:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940782.388825:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940782.388829:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2c00, rc 0) 00000100:00100000:1.0:1788940782.389030:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17449:x1875839718412544:12345-192.168.202.14@tcp:101:bash.0 Request processed in 580us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940782.389038:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788940782.391081:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.391194:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718412800 00000100:00100000:0.0:1788940782.391208:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718412800 00000100:00100000:0.0:1788940782.391323:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:0.0:1788940782.391336:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17449:x1875839718412800:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788940782.391921:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+15:17449:x1875839718412800:12345-192.168.202.14@tcp:35:bash.0 Request processed in 586us (850us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788940782.391931:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000040:00080000:2.0:1788940782.446710:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940782.463795:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.463933:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718413056 00000100:00100000:2.0:1788940782.463946:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718413056 00000100:00100000:2.0:1788940782.464007:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788940782.464016:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+15:17459:x1875839718413056:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.464045:0:18996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.464066:0:18996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c7ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e26 expref: -99 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.464312:0:18996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940782.464446:0:18996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c7ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e26 expref: 17 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.464618:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89f194b5b000) 00010000:00010000:2.0:1788940782.464622:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940782.464628:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c7ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e26 expref: 17 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.464643:0:18996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a800, rc 0) 00000100:00100000:2.0:1788940782.464756:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+16:17459:x1875839718413056:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 740us (976us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788940782.464765:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788940782.467746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.467865:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718413312 00000100:00100000:0.0:1788940782.467880:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718413312 00000100:00100000:0.0:1788940782.468002:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788940782.468016:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+16:17459:x1875839718413312:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788940782.468388:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+17:17459:x1875839718413312:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 375us (657us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788940782.468397:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788940782.509555:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.509663:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718413568 00000100:00100000:2.0:1788940782.509677:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718413568 00000100:00100000:2.0:1788940782.509778:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788940782.509791:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+17:17462:x1875839718413568:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.509822:0:18997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.509847:0:18997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c7f8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e2d expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.509971:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c7ff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.509987:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c7ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.510002:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c7ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.510038:0:18997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940782.510211:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c7f8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e2d expref: 20 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.510235:0:18997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c7ff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e2d expref: 19 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.510244:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940782.510246:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940782.510251:0:18997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a400, rc 0) 00000100:00100000:2.0:1788940782.510329:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17462:x1875839718413568:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 541us (821us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788940782.510337:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:3.0:1788940782.514369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940782.514425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.514658:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718413696 00000100:00100000:1.0:1788940782.514671:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718413696 00000100:00100000:1.0:1788940782.514753:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788940782.514766:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17462:x1875839718413696:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788940782.514858:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514899:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514915:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514948:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514956:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514964:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514970:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940782.514975:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514983:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.514996:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940782.515000:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940782.515005:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940782.515013:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3800/0x27a633fcdd4c80d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940782.515105:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17462:x1875839718413696:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 341us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940782.515119:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788940782.517783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.517882:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718414080 00000100:00100000:1.0:1788940782.517895:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718414080 00000100:00100000:1.0:1788940782.517967:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940782.517980:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17462:x1875839718414080:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788940782.518316:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+20:17462:x1875839718414080:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 338us (546us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788940782.518325:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788940782.521283:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718413824 00000100:00100000:2.0:1788940782.521306:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718413824 00000100:00100000:2.0:1788940782.521415:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940782.521427:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+20:2350:x1875839718413824:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940782.521446:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940782.521476:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c7ff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e2d expref: 20 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.521510:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940782.521537:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940782.521615:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf583100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+19:2350:x1875839718413824:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 190us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.521622:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788940782.897622:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940782.897969:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718414336 00000100:00100000:2.0:1788940782.897986:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718414336 00000100:00100000:2.0:1788940782.898070:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788940782.898083:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17493:x1875839718414336:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:2.0:1788940782.898117:0:18997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.898145:0:18997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c814 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e34 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.898288:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c81b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.898306:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c81b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.898321:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c81b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.898336:0:18997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940782.898774:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c814 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e34 expref: 22 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.898799:0:18997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c81b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e34 expref: 21 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.898809:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940782.898813:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940782.898818:0:18997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a800, rc 0) 00000100:00100000:2.0:1788940782.898905:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+21:17493:x1875839718414336:12345-192.168.202.14@tcp:101:cat.0 Request processed in 825us (1300us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788940782.898936:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788940782.909341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940782.909458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940782.910279:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718414720 00000100:00100000:0.0:1788940782.910295:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718414720 00000100:00100000:0.0:1788940782.910414:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788940782.910427:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+21:2353:x1875839718414720:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940782.910447:0:18982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940782.910479:0:18982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c81b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e34 expref: 21 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.910505:0:18982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940782.910511:0:18982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940782.910647:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+20:2353:x1875839718414720:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 221us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.910654:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:2.0:1788940782.912698:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718414592 00000100:00100000:2.0:1788940782.912767:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718414592 00000100:00100000:2.0:1788940782.912844:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788940782.912858:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+20:17493:x1875839718414592:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:2.0:1788940782.920264:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+21:17493:x1875839718414592:12345-192.168.202.14@tcp:35:cat.0 Request processed in 7234us (10765us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788940782.920283:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788940783.017782:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.020019:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718414976 00000100:00100000:2.0:1788940783.020042:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718414976 00000100:00100000:2.0:1788940783.020153:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788940783.020167:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+21:17499:x1875839718414976:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:2.0:1788940783.020202:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.020230:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c829 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e3b expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020353:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020368:0:20877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020375:0:20877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 22 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020381:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020435:0:20877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 22 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020446:0:20877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 22 pid: 18998 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.020459:0:20877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331264:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940783.020782:0:20877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.020790:0:20877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.020797:0:20877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf555180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331392:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940783.020818:0:20877:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf805300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940783.028596:0:20877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331264:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940783.028620:0:20877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf555180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20877:1875839738331392:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940783.028659:0:20877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940783.030894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940783.031007:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718415104 00000100:00100000:0.0:1788940783.031020:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718415104 00010000:00010000:0.0:1788940783.031079:0:18981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 23 pid: 18998 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.031270:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788940783.031284:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae729050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+23:2353:x1875839718415104:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940783.031323:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940783.031332:0:18981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 23 pid: 18998 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.031347:0:18981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 23 pid: 18998 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.031375:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2c00/0x27a633fcdd4c7e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e1f expref: 23 pid: 18998 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.031399:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940783.031406:0:18981:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.031416:0:18981:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.031424:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940783.031505:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae729050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+22:2353:x1875839718415104:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 223us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.031514:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788940783.035920:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.036002:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718415232 00000100:00100000:2.0:1788940783.036079:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718415232 00010000:00010000:2.0:1788940783.036380:0:18983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.036424:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788940783.036449:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+22:2352:x1875839718415232:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940783.036466:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940783.036474:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036491:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036550:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2600/0x27a633fcdd4c7ce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e18 expref: 22 pid: 20877 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036572:0:18983:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940783.036578:0:18983:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036590:0:18983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036598:0:18983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.036635:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940783.036719:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+21:2352:x1875839718415232:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 260us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.036728:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00010000:00010000:1.0:1788940783.036836:0:20877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.036846:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940783.036870:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940783.037098:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c829 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e3b expref: 22 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.037426:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a800/0x27a633fcdd4c830 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e3b expref: 21 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.037436:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940783.037450:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940783.037454:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a800, rc 0) 00000100:00100000:1.0:1788940783.037500:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+21:17499:x1875839718414976:12345-192.168.202.14@tcp:101:dd.0 Request processed in 17337us (19732us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788940783.037509:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788940783.040061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.040350:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718415488 00000100:00100000:2.0:1788940783.040362:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718415488 00000100:00100000:2.0:1788940783.040421:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788940783.040429:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+21:17499:x1875839718415488:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:2.0:1788940783.040833:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.040855:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.040870:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940783.040940:0:18998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788940783.040969:0:18998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001341e26e reply state 00000000c6180db4 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.040979:0:18998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940783.046333:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17499:x1875839718415488:12345-192.168.202.14@tcp:36:dd.0 Request processed in 5882us (6263us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788940783.046353:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000020:00080000:2.0:1788940783.046366:0:18998:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940783.048697:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048730:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048739:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048746:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940783.048752:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048762:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048784:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940783.048788:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940783.048794:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.048802:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c83e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.048941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.049201:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718415616 00000100:00100000:3.0:1788940783.049215:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718415616 00000100:00100000:3.0:1788940783.049284:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788940783.049297:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+23:17499:x1875839718415616:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:3.0:1788940783.049333:0:18996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940783.049357:0:18996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c845 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e42 expref: -99 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.049463:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c845 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e42 expref: 24 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.049478:0:18996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c845 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e42 expref: 24 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.049500:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940783.049503:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940783.049507:0:18996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96800, rc 0) 00000100:00100000:3.0:1788940783.049616:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17499:x1875839718415616:12345-192.168.202.14@tcp:101:dd.0 Request processed in 321us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.049623:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:0.0:1788940783.070363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.070469:0:18981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718415872 00000100:00100000:3.0:1788940783.070482:0:18981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718415872 00000100:00100000:3.0:1788940783.070613:0:18981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788940783.070628:0:18981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17499:x1875839718415872:12345-192.168.202.14@tcp:103:dd.0 00010000:00010000:3.0:1788940783.070649:0:18981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940783.070684:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c845 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e42 expref: 24 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.070738:0:18981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:3.0:1788940783.070745:0:18981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940783.070830:0:18981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+23:17499:x1875839718415872:12345-192.168.202.14@tcp:103:dd.0 Request processed in 204us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.070838:0:18981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788940783.081480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.083321:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416000 00000100:00100000:2.0:1788940783.083343:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416000 00000100:00100000:2.0:1788940783.083451:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:2.0:1788940783.083465:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+23:17499:x1875839718416000:12345-192.168.202.14@tcp:58:dd.0 00010000:00010000:2.0:1788940783.083648:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.083671:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.083687:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940783.084725:0:18997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940783.087324:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788940783.087463:0:18997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788940783.087660:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+23:17499:x1875839718416000:12345-192.168.202.14@tcp:58:dd.0 Request processed in 4191us (6198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.087676:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788940783.092018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.092957:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416128 00000100:00100000:2.0:1788940783.092977:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416128 00000100:00100000:2.0:1788940783.093068:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:2.0:1788940783.093081:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+23:17499:x1875839718416128:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:2.0:1788940783.093296:0:20877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.093326:0:20877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e49 expref: -99 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093400:0:20877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093413:0:20877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 24 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093438:0:20877:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093453:0:20877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 24 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093472:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940783.093491:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940783.093497:0:20877:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 24 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.093505:0:20877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a000, rc 0) 00000100:00100000:2.0:1788940783.093750:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17499:x1875839718416128:12345-192.168.202.14@tcp:101:dd.0 Request processed in 670us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.093759:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00010000:00010000:3.0:1788940783.149285:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940783.470939:0:19030:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788940783.470952:0:19030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940783.470997:0:19030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788940783.471005:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788940783.471334:0:19030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19030:1875839738331520:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788940783.471717:0:19030:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1bf805300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940783.482806:0:19030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf557480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19030:1875839738331520:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940783.487993:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940783.488332:0:19007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416256 00000100:00100000:0.0:1788940783.488348:0:19007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416256 00000100:00100000:0.0:1788940783.488430:0:19007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788940783.488443:0:19007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416256:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788940783.488594:0:19007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416256:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 Request processed in 152us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.488621:0:19007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788940783.507017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.507418:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416384 00000100:00100000:2.0:1788940783.507433:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416384 00000100:00100000:2.0:1788940783.507507:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788940783.507557:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416384:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940783.507602:0:18998:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940783.507752:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416384:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 235us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.507761:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:1.0:1788940783.513023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.513307:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416512 00000100:00100000:2.0:1788940783.513322:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416512 00000100:00100000:2.0:1788940783.513396:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:2.0:1788940783.513411:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416512:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.513586:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.513609:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.513623:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.513772:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.513801:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.513818:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514179:0:20877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514191:0:20877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514200:0:20877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940783.514248:0:20877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788940783.514252:0:20877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940783.514269:0:20877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514281:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514287:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514295:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514301:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940783.514305:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514313:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514327:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f194b5b200) 00010000:00010000:0.0:1788940783.514346:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940783.514353:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514362:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c85a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514381:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514388:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514394:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514400:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940783.514404:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514410:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514417:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff89f194b5b300) 00010000:00010000:0.0:1788940783.514420:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940783.514422:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514428:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c861 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514444:0:20877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514455:0:20877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514462:0:20877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514468:0:20877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812ea400 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:0.0:1788940783.514471:0:20877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514478:0:20877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514485:0:20877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:0.0:1788940783.514487:0:20877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940783.514490:0:20877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.514497:0:20877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f0812ea400/0x27a633fcdd4c868 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.514722:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416512:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 1299us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.514733:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:1.0:1788940783.519989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.520657:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416768 00000100:00100000:2.0:1788940783.520674:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416768 00000100:00100000:2.0:1788940783.520768:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788940783.520781:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+24:17501:x1875839718416768:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.520810:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.520838:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c86f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e50 expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.520974:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.520996:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521032:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940783.521059:0:18998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940783.521221:0:18998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521230:0:18998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521238:0:18998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521245:0:18998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b200 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940783.521250:0:18998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521259:0:18998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521275:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:2.0:1788940783.521279:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940783.521285:0:18998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521292:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c876 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521349:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c86f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e50 expref: 26 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521374:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89f194b5b200) 00010000:00010000:2.0:1788940783.521377:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940783.521382:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c86f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e50 expref: 26 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.521393:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b400, rc 0) 00000100:00100000:2.0:1788940783.521489:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+25:17501:x1875839718416768:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 711us (1514us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788940783.521498:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:1.0:1788940783.533601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.533785:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718416896 00000100:00100000:3.0:1788940783.533794:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718416896 00000100:00100000:3.0:1788940783.533846:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:3.0:1788940783.533854:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+25:17501:x1875839718416896:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940783.533884:0:18996:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940783.533988:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+25:17501:x1875839718416896:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 134us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.533996:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:0.0:1788940783.547628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.547765:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718417152 00000100:00100000:2.0:1788940783.547785:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718417152 00000100:00100000:2.0:1788940783.547887:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:2.0:1788940783.547901:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+25:17501:x1875839718417152:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.547932:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.547961:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c884 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e57 expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940783.549251:0:18998:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:2.0:1788940783.549263:0:18998:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788940783.550101:0:18998:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788940783.550904:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c88b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.550928:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c88b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.550942:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c88b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.551055:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c884 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e57 expref: 28 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.551078:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c88b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e57 expref: 27 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.551089:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5bb00) 00010000:00010000:2.0:1788940783.551092:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940783.551097:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b200, rc 0) 00000100:00100000:2.0:1788940783.551196:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+27:17501:x1875839718417152:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3297us (3577us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788940783.551208:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788940783.560062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.561074:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718417408 00000100:00100000:3.0:1788940783.561092:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718417408 00000100:00100000:3.0:1788940783.561182:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788940783.561192:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+27:17501:x1875839718417408:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940783.561248:0:18996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940783.561276:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c88b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e57 expref: 27 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561295:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5bb00) 00010000:00010000:3.0:1788940783.561306:0:18996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940783.561327:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561342:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561352:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561367:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561388:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561394:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561460:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561466:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561473:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561479:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940783.561483:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561491:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561500:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89f1983afe00) 00010000:00010000:3.0:1788940783.561507:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940783.561511:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561551:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96800/0x27a633fcdd4c899 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561562:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561573:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561578:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561583:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940783.561586:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561592:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561599:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x93402b03 (ffff89f18a6cec00) 00010000:00010000:3.0:1788940783.561603:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940783.561607:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.561614:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8a0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x93402b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.561719:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+26:17501:x1875839718417408:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 527us (1682us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940783.561726:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788940783.567756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.568106:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718417536 00000100:00100000:2.0:1788940783.568120:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718417536 00000100:00100000:2.0:1788940783.568680:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788940783.568696:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+26:17501:x1875839718417536:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.568738:0:18997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.568769:0:18997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c8a7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e5e expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.568816:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c8ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.568834:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c8ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.568849:0:18997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c8ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.568991:0:18997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c8a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e5e expref: 28 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.569016:0:18997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a400/0x27a633fcdd4c8ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e5e expref: 27 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.569027:0:18997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:2.0:1788940783.569030:0:18997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940783.569035:0:18997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477a400, rc 0) 00000100:00100000:2.0:1788940783.570969:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+27:17501:x1875839718417536:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1595us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.571406:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:1.0:1788940783.579886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.580009:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718417792 00000100:00100000:3.0:1788940783.580026:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718417792 00000100:00100000:3.0:1788940783.580167:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788940783.580181:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+27:17501:x1875839718417792:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940783.580314:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.580355:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.580371:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940783.583066:0:18996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1788940783.583094:0:18996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726481574409ns, next at 727481569454ns, rc = 0 00000004:00010000:3.0:1788940783.583238:0:18996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000262f2f0d reply state 000000002607d595 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.583253:0:18996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940783.587454:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+29:17501:x1875839718417792:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 7259us (7568us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788940783.587471:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00010000:00010000:2.0:1788940783.590585:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590611:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590621:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590627:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:2.0:1788940783.590633:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590642:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590663:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:2.0:1788940783.590685:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940783.590693:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.590699:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa96000/0x27a633fcdd4c8b5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.596970:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940783.597005:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940783.597114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940783.597402:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738331648 00000100:00100000:3.0:1788940783.597415:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738331648 00000100:00100000:3.0:1788940783.597513:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940783.597560:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738331648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940783.597609:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940783.597667:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875839738331648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.597675:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940783.597747:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875839738331648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788940783.597946:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940783.598285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.599788:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738332032:0@lo:400:kworker.0 00000100:00100000:3.0:1788940783.599857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940783.599916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940783.599923:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738332160:0@lo:400:kworker.0 00000100:00100000:3.0:1788940783.599950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940783.599983:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718417920 00000100:00100000:3.0:1788940783.599992:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718417920 00000100:00100000:1.0:1788940783.600141:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738332032 00000100:00100000:1.0:1788940783.600146:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738332032 00000100:00100000:1.0:1788940783.600180:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738332160 00000100:00100000:1.0:1788940783.600183:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738332160 00000100:00080000:1.0:1788940783.600208:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940783.600226:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940783.600235:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738332032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940783.600590:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f0821c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875839738332032:12345-0@lo:400:kworker.0 Request processed in 56us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.600601:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940783.600621:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940783.600628:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738332160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940783.600658:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875839738332160:12345-0@lo:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.600663:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940783.600677:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:1.0:1788940783.600683:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+28:17501:x1875839718417920:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940783.600702:0:18998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940783.600740:0:18998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e65 expref: -99 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.600820:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 29 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.600837:0:18998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 29 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.600858:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:1.0:1788940783.600862:0:18998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940783.600866:0:18998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2e00, rc 0) 00000100:00100000:1.0:1788940783.600915:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+29:17501:x1875839718417920:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 232us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.600922:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788940783.603559:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738331776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940783.603662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940783.603734:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738332288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940783.603769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940783.603804:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940783.603812:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738331904:0@lo:400:kworker.0 00000100:00100000:2.0:1788940783.603842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940783.603883:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738331904 00000100:00100000:2.0:1788940783.603892:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738331904 00000100:00100000:2.0:1788940783.603978:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940783.603989:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738331904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940783.604065:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738331904:12345-0@lo:400:kworker.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.604072:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940783.604127:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738331904:0@lo:400:kworker.0 00000100:00080000:1.0:1788940783.605278:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940783.605323:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738332288 00000100:00100000:1.0:1788940783.605332:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738332288 00000100:00100000:1.0:1788940783.605395:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940783.605405:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940783.605488:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875839738332288:12345-0@lo:400:kworker.0 Request processed in 84us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.605495:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940783.605872:0:18989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738331776 00000100:00100000:0.0:1788940783.605879:0:18989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738331776 00000100:00100000:0.0:1788940783.605932:0:18989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788940783.605941:0:18989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1aebfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3307:x1875839738331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940783.606008:0:18989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1aebfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7833fd5-ba21-4794-9436-ab89d07c3023+19:3307:x1875839738331776:12345-0@lo:400:kworker.0 Request processed in 68us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.606015:0:18989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1788940783.606129:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940783.606188:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7833fd5-ba21-4794-9436-ab89d07c3023:3307:1875839738331776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940783.606207:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f0821c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875839738332288:0@lo:400:kworker.0 00000100:00100000:3.0:1788940783.609098:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875839738332160:0@lo:400:kworker.0 00000100:00100000:3.0:1788940783.609134:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875839738332032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940783.610065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.610262:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718418048 00000100:00100000:2.0:1788940783.610274:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718418048 00000100:00100000:2.0:1788940783.610376:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788940783.610388:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2353:x1875839718418048:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788940783.610729:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940783.612145:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2353:x1875839718418048:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 1747us (2076us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788940783.613022:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788940783.619377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.619578:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718418304 00000100:00100000:2.0:1788940783.619593:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718418304 00000100:00100000:2.0:1788940783.619670:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940783.619682:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+29:17501:x1875839718418304:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940783.620018:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+30:17501:x1875839718418304:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 336us (654us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788940783.620027:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788940783.627135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940783.627414:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718418560 00000100:00100000:1.0:1788940783.627428:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718418560 00000100:00100000:1.0:1788940783.627754:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788940783.627788:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+30:17501:x1875839718418560:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940783.627954:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+30:17501:x1875839718418560:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 169us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.633832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.634280:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718418688 00000100:00100000:2.0:1788940783.634308:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718418688 00000100:00100000:1.0:1788940783.634683:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788940783.637583:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788940783.637622:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+30:17501:x1875839718418688:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.637658:0:18996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940783.637691:0:18996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c8c3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e6c expref: -99 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.637830:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.637849:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.637863:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940783.637913:0:18996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940783.637938:0:18996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.637970:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b400/0x27a633fcdd4c8c3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e6c expref: 32 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.637992:0:18996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e6c expref: 31 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.638002:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:2.0:1788940783.638005:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940783.638010:0:18996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f18477b200, rc 0) 00000100:00100000:2.0:1788940783.638117:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+31:17501:x1875839718418688:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 517us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.638126:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:1.0:1788940783.646632:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.646946:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718418816 00000100:00100000:3.0:1788940783.646961:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718418816 00000100:00100000:3.0:1788940783.647029:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788940783.647053:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2352:x1875839718418816:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940783.647077:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940783.647105:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e73 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940783.647138:0:20097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111f0, blocks: 0x1 00010000:00010000:3.0:1788940783.647175:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788940783.647181:0:20097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940783.647192:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 7 pid: 20097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.647216:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 7 pid: 20097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.647233:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f1bfa96800, rc 0) 00000100:00100000:3.0:1788940783.647339:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718418816:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 300us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.647346:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940783.657277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.660963:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419072 00000100:00100000:2.0:1788940783.660987:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419072 00000100:00100000:0.0:1788940783.661268:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:0.0:1788940783.661283:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+31:17501:x1875839718419072:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940783.661443:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+31:17501:x1875839718419072:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 164us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.661451:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788940783.674926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.675327:0:18997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419200 00000100:00100000:3.0:1788940783.675341:0:18997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419200 00000100:00100000:3.0:1788940783.675415:0:18997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788940783.675428:0:18997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+31:17501:x1875839718419200:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788940783.806423:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901899 is committed 00000001:00080000:0.0:1788940783.806448:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:0.0:1788940783.806455:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901904 is committed 00000001:00080000:0.0:1788940783.806468:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788940783.806514:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788940783.807225:0:18997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17501:x1875839718419200:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 131790us (132304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.807239:0:18997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788940783.807448:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940783.808602:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738332416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788940783.808713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940783.809134:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738332416 00000100:00100000:3.0:1788940783.809146:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738332416 00000100:00100000:3.0:1788940783.809314:0:19684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940783.809328:0:19684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875839738332416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788940783.809601:0:19684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788940783.809606:0:19684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788940783.809608:0:19684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788940783.809610:0:19684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788940784 -> 1788940784 00002000:00010000:3.0:1788940783.809613:0:19684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788940783.809669:0:19684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875839738332416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (964us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788940783.809678:0:19684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788940783.809783:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89f1b5831880/2, rc 0, transno 12884901891 00000100:00100000:0.0:1788940783.809792:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b5831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875839738332416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788940783.815405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.815781:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419328 00000100:00100000:3.0:1788940783.815797:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419328 00000100:00100000:3.0:1788940783.816241:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788940783.816256:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2353:x1875839718419328:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788940783.816429:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2353:x1875839718419328:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 177us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.816438:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788940783.821402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940783.821665:0:18998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419584 00000100:00100000:1.0:1788940783.821679:0:18998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419584 00000100:00100000:1.0:1788940783.821776:0:18998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:1.0:1788940783.821789:0:18998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17501:x1875839718419584:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940783.822082:0:18998:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940783.822124:0:18998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b200/0x27a633fcdd4c8ca lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e6c expref: 14 pid: 18996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.822148:0:18998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:1.0:1788940783.822219:0:18998:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940783.822268:0:18998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.822287:0:18998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.822298:0:18998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940783.826295:0:18998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8fb7dbd reply state 0000000073553602 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.826319:0:18998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940783.828135:0:18998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+15:17501:x1875839718419584:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 6332us (6731us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788940783.828148:0:18998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00010000:00010000:3.0:1788940783.839425:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839450:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839460:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839467:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3000 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:3.0:1788940783.839474:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839484:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839505:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:3.0:1788940783.839508:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940783.839514:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.839564:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3000/0x27a633fcdd4c8d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.842293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940783.843296:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419712 00000100:00100000:1.0:1788940783.843312:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419712 00000100:00100000:1.0:1788940783.843393:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788940783.843405:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:17501:x1875839718419712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940783.843433:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940783.843468:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa53ff0f493f5e7a expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.843512:0:19683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 8 pid: 20097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.843566:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940783.843571:0:19683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940783.843578:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 8 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.843657:0:19683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 8 pid: 20097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.843674:0:19683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 8 pid: 20097 timeout: 826 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940783.843691:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184473b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19683:1875839738332544:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940783.847265:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1834f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940783.853245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940783.853589:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419840 00000100:00100000:0.0:1788940783.853604:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419840 00010000:00010000:0.0:1788940783.853664:0:18982:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 9 pid: 20097 timeout: 826 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.853729:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940783.853741:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+9:2352:x1875839718419840:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940783.853770:0:18982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940783.853802:0:18982:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 9 pid: 20097 timeout: 826 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.853819:0:18982:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 9 pid: 20097 timeout: 826 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.853852:0:18982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940783.853858:0:18982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940783.853868:0:18982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.853889:0:18982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.853947:0:18982:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.853966:0:18982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1b4f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18982:1875839738332672:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788940783.854083:0:18982:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f186522840 going to sleep for 11 seconds 00010000:00010000:2.0:1788940783.854699:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93e1dd1/0x27a633fcdd4c8d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e73 expref: 9 pid: 20097 timeout: 826 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.854734:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184473b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19683:1875839738332544:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940783.854763:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 8 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.854776:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89f082ad2600, rc 0) 00000100:00100000:2.0:1788940783.854834:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+8:17501:x1875839718419712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 11431us (12936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.854844:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788940783.869831:0:18982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1b4f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18982:1875839738332672:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788940783.869884:0:18982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940783.869977:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718419840:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 16238us (16747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940783.869990:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788940783.876492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.879209:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718419968 00000100:00100000:3.0:1788940783.879231:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718419968 00000100:00100000:3.0:1788940783.879327:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788940783.879340:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718419968:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788940783.879855:0:20097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788940783.879859:0:20097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788940784 00002000:00010000:3.0:1788940783.879862:0:20097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788940783 00002000:00010000:3.0:1788940783.879995:0:20097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788940784 -> 1788940784 00002000:00010000:3.0:1788940783.879997:0:20097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788940783.880140:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+8:2352:x1875839718419968:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 801us (3661us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788940783.880150:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788940783.884335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.884446:0:19684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420096 00000100:00100000:3.0:1788940783.884459:0:19684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420096 00000100:00100000:3.0:1788940783.884751:0:19684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:3.0:1788940783.884764:0:19684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+8:2351:x1875839718420096:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788940783.884835:0:19684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.884863:0:19684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 8 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.884885:0:19684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940783.884891:0:19684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940783.884895:0:19684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.884945:0:19684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 8 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.884962:0:19684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 8 pid: 19683 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.885008:0:19684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19684:1875839738332800:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788940783.885133:0:19684:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f08214ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940783.887434:0:19684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19684:1875839738332800:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788940783.887485:0:19684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940783.888944:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.889178:0:18983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420224 00000100:00100000:3.0:1788940783.889190:0:18983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420224 00010000:00010000:3.0:1788940783.889241:0:18983:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.889291:0:18983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788940783.889302:0:18983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+9:2353:x1875839718420224:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940783.889320:0:18983:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940783.889352:0:18983:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.889366:0:18983:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.889392:0:18983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fe69bf4/0x27a633fcdd4c8df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e7a expref: 9 pid: 19683 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.889441:0:18983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940783.889446:0:18983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940783.889453:0:18983:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.889464:0:18983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.889504:0:18983:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940783.889620:0:18983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+8:2353:x1875839718420224:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 318us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940783.889629:0:18983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00010000:00010000:1.0:1788940783.889797:0:19684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889808:0:19684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889835:0:19684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889843:0:19684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889851:0:19684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889858:0:19684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97e00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940783.889863:0:19684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889873:0:19684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889895:0:19684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.889916:0:19684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb0a027a/0x27a633fcdd4c8e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940783.889976:0:19684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2351:x1875839718420096:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 5214us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.889984:0:19684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788940783.893651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.895494:0:18996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420480 00000100:00100000:2.0:1788940783.895540:0:18996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420480 00000100:00100000:2.0:1788940783.895630:0:18996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788940783.895643:0:18996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+14:17501:x1875839718420480:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940783.895767:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.895812:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.895828:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.898984:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.899023:0:18996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 15 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.899034:0:18996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.899089:0:18996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 15 pid: 18998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.899111:0:18996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 15 pid: 18998 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.899131:0:18996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18996:1875839738332928:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788940783.899257:0:18996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f08117dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940783.904301:0:18996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1bf554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18996:1875839738332928:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788940783.904347:0:18996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940783.906972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940783.907043:0:18982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420608 00000100:00100000:2.0:1788940783.907073:0:18982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420608 00010000:00010000:2.0:1788940783.907125:0:18982:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 16 pid: 18998 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.907174:0:18982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788940783.907185:0:18982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+16:2352:x1875839718420608:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940783.907206:0:18982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940783.907215:0:18982:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 16 pid: 18998 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907232:0:18982:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 16 pid: 18998 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907260:0:18982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad2e00/0x27a633fcdd4c8bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e65 expref: 16 pid: 18998 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907280:0:18982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:2.0:1788940783.907286:0:18982:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907298:0:18982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907308:0:18982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940783.907394:0:18982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940783.907464:0:18982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+15:2352:x1875839718420608:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 280us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.907482:0:18982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:3.0:1788940783.907598:0:18996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.907608:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940783.907881:0:18996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788940783.908064:0:18996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788940783.908119:0:18996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788940783.908219:0:18996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18996:1875839738333056:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788940783.911547:0:18996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940783.911667:0:18996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f08214e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940783.911716:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738333056 00000100:00100000:1.0:1788940783.911729:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738333056 00000100:00100000:1.0:1788940783.911825:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940783.911839:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18996:x1875839738333056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788940783.911841:0:19002:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788940783.911855:0:19002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788940783.912101:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18996:x1875839738333056:12345-0@lo:1000:mdt00_000.0 Request processed in 265us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.912111:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940783.912174:0:18996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae851f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18996:1875839738333056:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788940783.913774:0:18996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788940783.913905:0:18996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184472680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18996:1875839738333184:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788940783.913997:0:18996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940783.914035:0:18996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f192d71a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940783.914085:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738333184 00000100:00100000:3.0:1788940783.914101:0:19002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738333184 00000100:00100000:3.0:1788940783.914173:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940783.914184:0:19002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18996:x1875839738333184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788940783.914924:0:19002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18996:x1875839738333184:12345-0@lo:1000:mdt00_000.0 Request processed in 738us (923us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788940783.914954:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940783.915149:0:18996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184472680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18996:1875839738333184:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788940783.915215:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915227:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915250:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915256:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b800 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940783.915262:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915273:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915292:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:1.0:1788940783.915295:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940783.915301:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915309:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477b800/0x27a633fcdd4c8f4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915349:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915355:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915361:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915367:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477bc00 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940783.915370:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915387:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915395:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940783.915424:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940783.915432:0:18996:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 18 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915445:0:18996:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 18 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915456:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 18 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.915672:0:18996:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a000/0x27a633fcdd4c853 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0xa53ff0f493f5e49 expref: 18 pid: 20877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940783.915687:0:18996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f184471180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18996:1875839738333312:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788940783.915859:0:18996:0:(client.c:2716:ptlrpc_set_wait()) set ffff89f1841b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940783.919850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940783.920045:0:18996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f184471180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18996:1875839738333312:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788940783.920087:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920101:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477bc00/0x27a633fcdd4c84c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920145:0:18996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.920194:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420736 00010000:00010000:1.0:1788940783.920195:0:18996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.920206:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420736 00010000:00010000:1.0:1788940783.920214:0:18996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920228:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920236:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920244:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920250:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940783.920255:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920263:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920276:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00000100:00100000:2.0:1788940783.920283:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00010000:00010000:1.0:1788940783.920283:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940783.920289:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920298:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f082ad3600/0x27a633fcdd4c8fb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.920307:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b9fb3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17499:x1875839718420736:12345-192.168.202.14@tcp:49:dd.0 00010000:00010000:1.0:1788940783.920315:0:18996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.920331:0:18999:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00010000:00010000:1.0:1788940783.920333:0:18996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920352:0:18996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940783.920356:0:18999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:1.0:1788940783.920367:0:18996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a600 already unused, calling callback (ffffffffc21374f0) 00010000:00010000:1.0:1788940783.920370:0:18996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920378:0:18996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920387:0:18996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89f1983af600) 00010000:00010000:1.0:1788940783.920390:0:18996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940783.920394:0:18996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940783.920400:0:18996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f18477a600/0x27a633fcdd4c8ed lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940783.920500:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b9fb3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+19:17499:x1875839718420736:12345-192.168.202.14@tcp:49:dd.0 Request processed in 205us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.920510:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788940783.920742:0:18996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+18:17501:x1875839718420480:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 25100us (27104us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788940783.920753:0:18996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000020:00080000:1.0:1788940783.921499:0:18996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788940783.921675:0:19030:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788940783.921681:0:19030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940783.921726:0:19030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788940783.921733:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788940783.923987:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940783.924047:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718420992 00000100:00100000:3.0:1788940783.924061:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718420992 00000100:00100000:3.0:1788940783.924126:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788940783.924137:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+18:17501:x1875839718420992:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788940783.924906:0:18999:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940783.925017:0:18999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788940783.925060:0:18999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925077:0:18999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925089:0:18999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925098:0:18999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925105:0:18999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925111:0:18999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940783.925127:0:18999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940783.925230:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+20:17501:x1875839718420992:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 1093us (1254us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788940783.925238:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000020:00080000:3.0:1788940783.925250:0:18999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940783.927568:0:18985:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940783.927585:0:18985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.927598:0:18985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa97600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:0.0:1788940783.927604:0:18985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.927615:0:18985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.927637:0:18985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89f194b5b100) 00010000:00010000:0.0:1788940783.927640:0:18985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940783.927646:0:18985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.927652:0:18985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89f1bfa97600/0x27a633fcdd4c902 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940783.927669:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940783.927671:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940783.927673:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940784.120378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940784.120418:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940784.120477:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421120 00000100:00100000:3.0:1788940784.120492:0:18991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421120 00000100:00100000:3.0:1788940784.120580:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:3.0:1788940784.120593:0:18991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1ae72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2352:x1875839718421120:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788940784.120717:0:18991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1ae72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e98e7af8-38de-4d12-88f8-5d012de21ab3+13:2352:x1875839718421120:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 126us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940784.120725:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:0.0:1788940784.124048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940784.124075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940784.124099:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940784.124132:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421632 00000100:00100000:0.0:1788940784.124144:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421632 00000100:00100000:0.0:1788940784.124215:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421248 00000100:00100000:0.0:1788940784.124219:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421248 00000100:00100000:0.0:1788940784.124236:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421504 00000100:00100000:0.0:1788940784.124238:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421504 00000100:00100000:0.0:1788940784.124258:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940784.124268:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2352:x1875839718421632:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940784.124358:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2352:x1875839718421632:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940784.124367:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788940784.124388:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:0.0:1788940784.124395:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2352:x1875839718421248:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940784.124421:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b5c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2352:x1875839718421248:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940784.124428:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:0.0:1788940784.124441:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788940784.124447:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2352:x1875839718421504:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940784.124475:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+5:2352:x1875839718421504:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940784.124481:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00080000:0.0:1788940784.124557:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940784.124562:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940784.124897:0:20877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421376 00000100:00100000:0.0:1788940784.124904:0:20877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421376 00000100:00100000:0.0:1788940784.124946:0:20877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:0.0:1788940784.124953:0:20877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2352:x1875839718421376:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788940784.124997:0:20877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1b4f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3bcb74-f9cb-4f94-9c90-a6ed3df0e3fa+6:2352:x1875839718421376:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 45us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940784.125004:0:20877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00080000:0.0:1788940784.125047:0:18992:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788940784.148063:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00000001:00080000:2.0:1788940784.148080:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00080000:2.0:1788940784.148086:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000100:00100000:0.0:1788940784.157760:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940784.157875:0:19688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421760 00000100:00100000:2.0:1788940784.157887:0:19688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421760 00000100:00100000:2.0:1788940784.157962:0:19688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788940784.157974:0:19688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2353:x1875839718421760:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:2.0:1788940784.158027:0:19688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6aa111f0, atime: 0x6aa111ef, ctime: 0x6aa111f0, blocks: 0x1 00010000:00010000:2.0:1788940784.158038:0:19688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.158055:0:19688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1788940784.158060:0:19688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940784.158067:0:19688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.158102:0:19688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940784.167025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940784.167134:0:19690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940784.167144:0:19690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788940784.169804:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788940784.169907:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718421888 00000100:00100000:2.0:1788940784.169919:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718421888 00000100:00100000:2.0:1788940784.169977:0:19690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788940784.169985:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422016 00000100:00100000:2.0:1788940784.169988:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422016 00000100:00100000:1.0:1788940784.170967:0:21135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788940784.170987:0:21135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+8:2350:x1875839718421888:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:1.0:1788940784.171027:0:21135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.171058:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940784.171062:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940784.171069:0:21135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.171084:0:21135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.175273:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940784.310894:0:21135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788940784.310904:0:21135:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788940784 -> 1788940785 00002000:00010000:3.0:1788940784.310907:0:21135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1788940784.310921:0:21135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.310934:0:21135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.310944:0:21135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.310952:0:21135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad3600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940784.310957:0:21135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.310967:0:21135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.311002:0:21135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.311009:0:21135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c71178a2/0x27a633fcdd4c910 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311070:0:19688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311154:0:19688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311163:0:19688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311170:0:19688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477a600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940784.311174:0:19688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311182:0:19688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311194:0:19688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.311212:0:19688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cec3372f/0x27a633fcdd4c909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940784.311661:0:21135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+11:2350:x1875839718421888:12345-192.168.202.14@tcp:4:dd.0 Request processed in 140672us (144639us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788940784.311671:0:21135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:3.0:1788940784.311737:0:21135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788940784.311753:0:21135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+10:2352:x1875839718422016:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:3.0:1788940784.311796:0:21135:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 2097152, mtime: 0x6aa111f1, atime: 0x6aa111ef, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788940784.311803:0:21135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.311814:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1788940784.311819:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940784.311825:0:21135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.311837:0:21135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940784.313134:0:19688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:004757e8-569f-44da-9c79-72fc5ef7a72e+11:2353:x1875839718421760:12345-192.168.202.14@tcp:4:dd.0 Request processed in 155154us (155378us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788940784.313146:0:19688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000001:00080000:2.0:1788940784.313184:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00002000:00010000:3.0:1788940784.407620:0:21135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788940784.407632:0:21135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788940784.407661:0:21135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407675:0:21135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407684:0:21135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407692:0:21135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940784.407707:0:21135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407717:0:21135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407737:0:21135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.407745:0:21135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c917 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940784.407854:0:21135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+7:2352:x1875839718422016:12345-192.168.202.14@tcp:4:dd.0 Request processed in 96103us (238052us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788940784.407864:0:21135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000001:00080000:0.0:1788940784.408685:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00000100:00100000:1.0:1788940784.426161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940784.426210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788940784.426899:0:19689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422144 00000100:00100000:3.0:1788940784.426919:0:19689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422144 00000100:00100000:3.0:1788940784.427052:0:19689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422272 00000100:00100000:3.0:1788940784.427057:0:19689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422272 00000100:00100000:3.0:1788940784.427110:0:19689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:3.0:1788940784.427124:0:19689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2351:x1875839718422144:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:3.0:1788940784.427207:0:19689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aa111f1, atime: 0x6aa111ef, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788940784.427219:0:19689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.427241:0:19689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=727s v=(0 0) 00010000:00010000:3.0:1788940784.427248:0:19689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940784.427256:0:19689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.427277:0:19689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940784.427661:0:21135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788940784.427683:0:21135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+6:2351:x1875839718422272:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:0.0:1788940784.427744:0:21135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.427763:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940784.427768:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940784.427774:0:21135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.427790:0:21135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940784.449808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940784.450067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788940784.450120:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788940784.450472:0:19688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940784.450500:0:19688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788940784.452686:0:19690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788940784.452724:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422400 00000100:00100000:3.0:1788940784.452738:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422400 00000100:00100000:3.0:1788940784.452820:0:19690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788940784.452828:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422656 00000100:00100000:3.0:1788940784.452831:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422656 00000100:00100000:3.0:1788940784.452847:0:19690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788940784.452861:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839718422528 00000100:00100000:3.0:1788940784.452864:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839718422528 00000100:00100000:2.0:1788940784.459182:0:21137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788940784.459200:0:21137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:004757e8-569f-44da-9c79-72fc5ef7a72e+11:2351:x1875839718422400:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:2.0:1788940784.459242:0:21137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.459261:0:21137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940784.459265:0:21137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940784.459272:0:21137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.459287:0:21137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940784.535995:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00002000:00010000:2.0:1788940784.541534:0:21135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1788940784.541547:0:21135:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788940785 00002000:00010000:2.0:1788940784.541550:0:21135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1788940784.541568:0:21135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541602:0:21135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541611:0:21135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541619:0:21135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f0812eb600 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940784.541624:0:21135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541635:0:21135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541660:0:21135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.541668:0:21135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005215e8ae/0x27a633fcdd4c925 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940784.541791:0:21135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+15:2351:x1875839718422272:12345-192.168.202.14@tcp:4:dd.0 Request processed in 114109us (115572us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788940784.541803:0:21135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:2.0:1788940784.541997:0:21135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788940784.542012:0:21135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+14:2351:x1875839718422656:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:2.0:1788940784.542053:0:21135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.542073:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940784.542078:0:21135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940784.542100:0:21135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.542114:0:21135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940784.581473:0:19689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:1.0:1788940784.581501:0:19689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581549:0:19689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581562:0:19689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581597:0:19689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f1bfa96c00 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:1.0:1788940784.581604:0:19689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581615:0:19689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581643:0:19689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581654:0:19689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000212cb6fc/0x27a633fcdd4c91e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940784.581796:0:19689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+16:2351:x1875839718422144:12345-192.168.202.14@tcp:4:dd.0 Request processed in 154666us (155635us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788940784.581810:0:19689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788940784.581858:0:19689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788940784.581873:0:19689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f184471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+15:2351:x1875839718422528:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:1.0:1788940784.581917:0:19689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581934:0:19689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940784.581939:0:19689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940784.581948:0:19689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.581976:0:19689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940784.585346:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00000001:00080000:0.0:1788940784.585383:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00002000:00010000:3.0:1788940784.587855:0:21137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788940784.587889:0:21137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587906:0:21137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587932:0:21137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587940:0:21137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940784.587946:0:21137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587956:0:21137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587984:0:21137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.587993:0:21137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009b15da7/0x27a633fcdd4c92c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940784.588142:0:21137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:004757e8-569f-44da-9c79-72fc5ef7a72e+11:2351:x1875839718422400:12345-192.168.202.14@tcp:4:dd.0 Request processed in 128940us (138343us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788940784.588160:0:21137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788940784.624400:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940784.624431:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738333440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940784.624548:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940784.624635:0:19685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839738333440 00000100:00100000:2.0:1788940784.624644:0:19685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839738333440 00000100:00100000:2.0:1788940784.624712:0:19685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940784.624725:0:19685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738333440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940784.624772:0:19685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940784.624825:0:19685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f1bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875839738333440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940784.624832:0:19685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940784.624892:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89f1ae850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875839738333440:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788940784.636028:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00010000:00010000:2.0:1788940784.636650:0:21135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636668:0:21135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636773:0:21135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636783:0:21135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f18477b400 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:2.0:1788940784.636788:0:21135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636800:0:21135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636826:0:21135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.636835:0:21135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbca7760/0x27a633fcdd4c933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940784.636966:0:21135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:004757e8-569f-44da-9c79-72fc5ef7a72e+9:2351:x1875839718422656:12345-192.168.202.14@tcp:4:dd.0 Request processed in 94951us (186891us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788940784.636980:0:21135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000001:00080000:0.0:1788940784.724810:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:3.0:1788940784.725052:0:19689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788940784.725074:0:19689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725090:0:19689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725139:0:19689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725161:0:19689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89f082ad2800 already unused, calling callback (ffffffffc16f3760) 00010000:00010000:3.0:1788940784.725167:0:19689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725177:0:19689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725204:0:19689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940784.725213:0:19689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f0c9bd/0x27a633fcdd4c93a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940784.725349:0:19689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89f184471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:004757e8-569f-44da-9c79-72fc5ef7a72e+5:2351:x1875839718422528:12345-192.168.202.14@tcp:4:dd.0 Request processed in 143474us (275221us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788940784.725362:0:19689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00010000:00010000:0.0:1788940785.196984:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940786.226645:0:18984:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940786.244118:0:21174:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:0.0:1788940786.989331:0:19030:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788940786.989345:0:19030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940786.989385:0:19030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788940786.989392:0:19030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788940787.246539:0:18985:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9790 lines, 9790 kept, 0 dropped, 0 bad.